You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-25 - 05:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Sat Apr 25, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1330629785,8sleep20-21swapper/219:09:042
1327428572,8sleep00-21swapper/019:08:380
1323528560,9sleep30-21swapper/319:08:083
1323328058,6sleep10-21swapper/119:08:061
1347099300,29cyclictest0-21swapper/222:11:142
1346599270,27cyclictest0-21swapper/123:14:141
13465992623,2cyclictest6053-21diskmemload00:24:301
13470992524,1cyclictest0-21swapper/200:26:022
1347099250,23cyclictest0-21swapper/223:58:232
1347099250,23cyclictest0-21swapper/223:58:232
1346599250,2cyclictest0-21swapper/123:55:581
1346599250,2cyclictest0-21swapper/123:55:581
1347099230,1cyclictest0-21swapper/220:00:132
13461992322,1cyclictest0-21swapper/022:04:160
1346599213,4cyclictest25-21ksoftirqd/119:42:281
13465992111,9cyclictest6053-21diskmemload23:50:161
1346199210,21cyclictest0-21swapper/022:49:560
1347299200,1cyclictest0-21swapper/323:22:343
1347099200,20cyclictest0-21swapper/223:24:062
1346599208,11cyclictest17356-21cut00:10:161
1346199201,6cyclictest0-21swapper/023:29:360
1346199200,20cyclictest0-21swapper/022:20:500
1346199200,1cyclictest0-21swapper/000:17:260
13472991918,1cyclictest0-21swapper/321:40:143
1347099190,18cyclictest0-21swapper/221:23:182
13465991917,1cyclictest0-21swapper/122:20:001
1346599190,1cyclictest0-21swapper/121:35:421
1346599190,14cyclictest25-21ksoftirqd/123:08:201
13470991818,0cyclictest0-21swapper/222:31:142
13470991818,0cyclictest0-21swapper/222:31:132
1347099180,16cyclictest0-21swapper/223:39:302
1346599186,3cyclictest25-21ksoftirqd/121:33:591
13465991812,2cyclictest225-21systemd-journal00:07:291
1346599180,1cyclictest0-21swapper/121:10:411
13461991818,0cyclictest0-21swapper/023:07:390
13461991815,1cyclictest0-21swapper/022:35:300
1347099170,13cyclictest0-21swapper/200:09:142
1346599178,2cyclictest25-21ksoftirqd/122:21:201
13465991716,1cyclictest0-21swapper/122:35:531
13465991712,5cyclictest25-21ksoftirqd/122:25:341
13465991712,2cyclictest6053-21diskmemload22:41:391
1346599170,1cyclictest0-21swapper/123:15:071
1346599170,17cyclictest0-21swapper/119:50:121
1346199170,1cyclictest0-21swapper/000:37:210
1347099160,16cyclictest0-21swapper/223:46:322
1347099160,15cyclictest0-21swapper/221:46:352
1347099160,0cyclictest0-21swapper/200:35:312
1346599165,11cyclictest0-21swapper/121:52:541
1346599164,12cyclictest0-21swapper/121:41:091
13465991615,1cyclictest0-21swapper/100:15:151
13465991613,3cyclictest25-21ksoftirqd/123:29:371
13465991613,1cyclictest6053-21diskmemload21:29:571
1346599161,1cyclictest7561-21ssh21:49:271
1346599160,4cyclictest0-21swapper/123:24:361
1346599160,16cyclictest0-21swapper/122:32:321
1346599160,16cyclictest0-21swapper/122:32:321
13461991615,1cyclictest0-21swapper/023:00:230
1347099159,5cyclictest20785-21grep22:35:222
1347099151,8cyclictest537-21snmpd22:46:202
1346599157,8cyclictest0-21swapper/122:12:281
1346599156,8cyclictest0-21swapper/122:07:311
1346599156,8cyclictest0-21swapper/121:16:411
1346599154,11cyclictest0-21swapper/100:25:141
13465991512,2cyclictest6053-21diskmemload00:04:311
13465991510,5cyclictest6053-21diskmemload00:37:111
1346199151,7cyclictest32244-21awk21:45:000
1346199150,1cyclictest0-21swapper/022:32:310
1346199150,1cyclictest0-21swapper/022:32:310
13472991413,1cyclictest0-21swapper/323:42:173
13472991411,3cyclictest39-21ksoftirqd/322:17:473
13472991411,2cyclictest4444-21uniq22:45:193
13472991411,2cyclictest31407-21cron00:00:003
13472991411,2cyclictest31407-21cron00:00:003
13472991410,3cyclictest32368-21cut21:25:163
13472991410,3cyclictest11219-21tr22:30:153
13472991410,3cyclictest11219-21tr22:30:153
1347299140,12cyclictest2170-21wc00:20:213
1347099141,2cyclictest0-21swapper/200:03:302
13470991412,1cyclictest0-21swapper/223:05:582
13470991411,2cyclictest7792-21grep23:25:262
13470991410,3cyclictest27018-21grep20:45:162
13470991410,3cyclictest16810-21grep19:15:172
13470991410,3cyclictest15970-21wc23:30:242
1347099140,14cyclictest0-21swapper/222:21:572
1347099140,12cyclictest0-21swapper/222:52:332
1346599148,6cyclictest0-21swapper/121:59:031
13465991413,1cyclictest0-21swapper/122:00:141
13465991412,2cyclictest6053-21diskmemload22:59:211
13465991412,1cyclictest11590-21cron22:49:591
1346199141,6cyclictest6053-21diskmemload23:50:010
13461991410,3cyclictest23561-21sed23:35:190
1347299139,3cyclictest31136-21cron21:25:003
1347299139,3cyclictest19423-21cat00:30:263
1347299139,3cyclictest18616-21cut19:20:143
13472991310,2cyclictest3320-21grep22:05:263
13472991310,2cyclictest30695-21wc20:50:243
13472991310,2cyclictest30495-21wc23:40:003
13472991310,2cyclictest2302-21grep21:45:283
13472991310,2cyclictest15500-21ls23:30:203
13472991310,2cyclictest13270-21sed20:15:183
1347299130,3cyclictest0-21swapper/300:06:003
1347099139,3cyclictest26817-21grep19:35:202
1347099139,3cyclictest24413-21ssh21:40:132
1347099139,2cyclictest28711-21grep19:40:172
1347099131,11cyclictest0-21swapper/221:13:332
13470991310,2cyclictest8384-21sort21:30:172
13470991310,2cyclictest3319-21wc22:45:012
13470991310,2cyclictest21603-21head19:25:172
13470991310,2cyclictest18590-21wc20:25:232
13470991310,2cyclictest16271-21cat23:50:182
13470991310,2cyclictest13135-21grep20:15:172
1347099130,1cyclictest0-21swapper/222:16:352
1346599139,1cyclictest14298-21taskset20:16:131
1346599138,4cyclictest30956-21taskset20:51:111
1346599137,6cyclictest0-21swapper/123:34:581
1346599137,5cyclictest0-21swapper/121:23:531
1346599137,1cyclictest141rcu_preempt23:01:441
1346599135,7cyclictest31184-21grep23:40:151
13465991311,2cyclictest0-21swapper/123:45:361
1346199139,3cyclictest29495-21sort23:20:000
1346199139,3cyclictest28484-21head20:45:270
1346199134,8cyclictest26529-21munin-run20:45:000
1346199134,8cyclictest26529-21munin-run20:44:590
13461991310,2cyclictest5502-21grep21:05:250
13461991310,2cyclictest31748-21cut19:45:230
1346199130,2cyclictest0-21swapper/023:54:300
1346199130,1cyclictest0-21swapper/021:53:110
1346199130,13cyclictest0-21swapper/021:37:380
1346199130,12cyclictest622-21cut21:25:220
1347299129,2cyclictest9588-21ssh00:25:153
1347299129,2cyclictest4605-21grep22:25:273
1347299129,2cyclictest28885-21sh23:00:143
1347299129,2cyclictest27824-21tr22:40:143
1347299129,2cyclictest27222-21grep19:35:243
1347299129,2cyclictest20569-21basename22:55:123
1347299129,2cyclictest16279-21grep21:35:153
1347299129,2cyclictest11877-21rm21:51:183
1347299129,2cyclictest10613-21grep22:10:163
1347299128,3cyclictest5487-21grep21:05:253
1347299128,3cyclictest21628-21sed19:25:173
1347299128,3cyclictest17370-21grep20:25:153
1347299121,11cyclictest0-21swapper/321:18:393
1347299120,2cyclictest19075-21sh00:10:543
1347099129,2cyclictest24126-21ls20:40:002
1347099129,2cyclictest22284-21tune2fs23:15:172
1347099129,2cyclictest19548-21grep00:30:262
1347099129,2cyclictest17927-21tr21:55:172
1347099129,2cyclictest15564-21cut20:20:152
1347099129,2cyclictest15050-21sed23:10:232
1347099129,2cyclictest10543-21cron22:30:002
1347099128,3cyclictest30371-21chrt19:45:132
1347099128,3cyclictest1213-21grep21:25:262
1347099124,6cyclictest32623-21timerandwakeup23:40:262
1347099123,6cyclictest26115-21df_abs22:00:162
1347099120,2cyclictest0-21swapper/221:52:272
1347099120,12cyclictest0-21swapper/222:09:192
1347099120,11cyclictest0-21swapper/223:00:052
1346599129,3cyclictest0-21swapper/100:32:051
1346599129,2cyclictest5863-21head20:00:161
1346599129,2cyclictest4364-21grep19:55:261
1346599129,2cyclictest27710-21sh19:40:001
1346599129,2cyclictest26009-21grep20:40:251
1346599129,2cyclictest26009-21grep20:40:251
1346599129,2cyclictest10498-21cut20:10:161
1346599128,3cyclictest32452-21seq19:49:521
1346599128,3cyclictest22842-21tr23:35:141
1346599127,4cyclictest0-21swapper/119:30:151
1346599126,4cyclictest25-21ksoftirqd/120:07:311
1346599126,4cyclictest25-21ksoftirqd/119:26:111
1346599126,4cyclictest25-21ksoftirqd/119:23:521
1346599123,9cyclictest0-21swapper/122:52:561
1346199129,2cyclictest30414-21wc20:50:210
1346199129,2cyclictest29209-21sed19:40:210
1346199129,2cyclictest2220-21grep22:05:170
1346199129,2cyclictest21358-21ls22:55:170
1346199129,2cyclictest15798-21cut21:15:170
1346199129,1cyclictest0-21swapper/000:27:210
1346199123,3cyclictest25006-21sendmail22:00:000
1346199122,4cyclictest225-21systemd-journal00:07:300
1346199121,9cyclictest0-21swapper/023:44:120
1346199120,6cyclictest11421-21timerandwakeup20:10:250
1346199120,1cyclictest0-21swapper/000:31:020
1346199120,12cyclictest0-21swapper/021:32:240
1346199120,0cyclictest0-21swapper/022:25:220
1347299118,2cyclictest8866-21ssh23:26:123
1347299118,2cyclictest8361-21cat21:10:253
1347299118,2cyclictest794-21sed20:55:263
1347299118,2cyclictest6990-21cut23:45:153
1347299118,2cyclictest6083-21ntpq23:05:193
1347299118,2cyclictest5962-21ssh00:03:523
1347299118,2cyclictest5088-21apache_processe20:00:123
1347299118,2cyclictest31107-21head19:45:173
1347299118,2cyclictest28845-21taskset20:49:343
1347299118,2cyclictest28243-21ssh00:35:353
1347299118,2cyclictest26521-21ssh22:20:053
1347299118,2cyclictest26337-21head22:00:173
1347299118,2cyclictest25610-21grep00:15:183
1347299118,2cyclictest23710-21sh23:15:343
1347299118,2cyclictest21564-21ssh21:57:193
1347299118,2cyclictest16160-21cat23:50:183
1347299118,2cyclictest15391-21sh23:10:353
1347299118,2cyclictest15390-21grep19:10:263
1347299118,2cyclictest15140-21grep20:20:133
1347299118,2cyclictest14614-21ssh21:34:183
1347299118,2cyclictest12015-21grep20:15:003
1347299117,3cyclictest13462-21sed22:50:213
1347299115,1cyclictest20620-21sed22:35:203
1347299112,4cyclictest19645-21apt-get20:30:143
1347099118,2cyclictest3967-21cut21:05:132
1347099118,2cyclictest32-21ksoftirqd/220:00:002
1347099118,2cyclictest23651-21cat19:30:142
1347099118,2cyclictest20800-21rm21:37:372
1347099118,2cyclictest19519-21ssh00:11:152
1347099118,2cyclictest16901-21grep21:15:262
1347099116,2cyclictest225-21systemd-journal21:00:002
1347099110,1cyclictest0-21swapper/200:22:332
1347099110,0cyclictest0-21swapper/222:55:222
1346599118,2cyclictest23714-21grep20:35:251
1346599118,2cyclictest2260-21head21:00:161
1346599118,2cyclictest17854-21chrt19:15:511
1346599118,2cyclictest1258-21awk21:00:001
1346599117,3cyclictest19298-21taskset20:29:111
1346599117,1cyclictest15664-21taskset19:13:181
1346199118,2cyclictest8621-21cat20:05:190
1346199118,2cyclictest7814-21cut21:10:190
1346199118,2cyclictest462-21sensors20:55:240
1346199118,2cyclictest4141-21ssh00:21:320
1346199118,2cyclictest383-21tr19:50:140
1346199118,2cyclictest32184-21ssh23:20:390
1346199118,2cyclictest26942-21ssh21:21:410
1346199118,2cyclictest26569-21ssh23:56:140
1346199118,2cyclictest26569-21ssh23:56:140
1346199118,2cyclictest22091-21ssh00:13:170
1346199118,2cyclictest21613-21grep19:25:160
1346199118,2cyclictest19959-21expr19:20:250
1346199118,2cyclictest1980-21taskset21:00:140
1346199118,2cyclictest17932-21grep20:25:170
1346199118,2cyclictest17874-21ssh22:15:010
1346199118,2cyclictest16390-21ssh22:14:010
1346199118,2cyclictest1612-21ssh00:00:290
1346199118,2cyclictest15543-21head23:30:200
1346199118,2cyclictest14259-21rm22:50:330
1346199118,2cyclictest13604-21uname20:15:210
1346199118,2cyclictest13406-21tr23:10:120
1346199117,3cyclictest7009-21systemd-cgroups20:01:560
1347299108,1cyclictest8314-21hddtemp_smartct20:05:173
1347299108,1cyclictest24741-21ls20:40:143
1347299108,1cyclictest24741-21ls20:40:143
1347299108,1cyclictest16524-21cat19:15:153
1347299107,2cyclictest3827-21chrt19:55:203
1347299107,2cyclictest1498-21apache_accesses21:00:113
1347299107,2cyclictest1246-21uname19:50:193
1347299100,9cyclictest28064-21tr19:40:143
1347099108,1cyclictest291142sleep220:50:042
1347099108,1cyclictest26278-21taskset20:42:042
1347099108,1cyclictest26278-21taskset20:42:042
1347099108,1cyclictest19494-21load19:20:192
1347099107,2cyclictest7539-21basename20:05:142
1347099107,2cyclictest307-21grep19:50:132
1347099107,2cyclictest25595-21tune2fs00:15:182
1347099107,2cyclictest2241-21head21:00:162
1347099107,2cyclictest21479-21taskset20:31:402
1347099107,2cyclictest11717-21taskset20:11:242
1346599108,1cyclictest5718-21taskset21:06:371
1346599108,1cyclictest167802sleep120:22:191
1346599107,2cyclictest20078-21cat20:30:141
1346599104,5cyclictest0-21swapper/120:45:141
1346199108,2cyclictest24540-21sendmail_mailqu19:30:210
1346199108,1cyclictest27749-21ssh22:40:120
1346199108,1cyclictest20903-21uname20:30:220
1346199108,1cyclictest14851-21ntp_states19:10:200
1346199107,2cyclictest32534-21ssh21:45:050
1346199107,2cyclictest27596-21taskset19:38:420
1346199107,2cyclictest23448-21cat20:35:240
1346199101,2cyclictest225-21systemd-journal19:20:010
134729997,1cyclictest23430-21cat19:30:143
134729997,1cyclictest22407-21expr20:35:143
134709996,2cyclictest13969-21grep19:10:132
134619997,1cyclictest4678-21taskset19:58:330
134619997,1cyclictest167062sleep020:21:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional