You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-26 - 21:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Sun Jul 26, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
192999766,62cyclictest0-21swapper/109:55:331
193199744,63cyclictest0-21swapper/310:30:183
193199744,63cyclictest0-21swapper/310:30:183
193099745,62cyclictest0-21swapper/209:35:282
193099724,61cyclictest0-21swapper/210:15:172
1925997243,13cyclictest0-21swapper/009:45:160
193099715,59cyclictest0-21swapper/210:04:172
193099715,58cyclictest0-21swapper/211:00:052
193099715,57cyclictest0-21swapper/209:50:212
193099715,57cyclictest0-21swapper/209:50:212
193099714,59cyclictest0-21swapper/208:00:162
192999714,27cyclictest0-21swapper/111:25:221
193099705,57cyclictest0-21swapper/208:45:272
193099704,59cyclictest0-21swapper/209:45:222
193099704,58cyclictest0-21swapper/210:54:492
192999705,26cyclictest0-21swapper/108:50:261
1931996938,13cyclictest0-21swapper/307:20:123
1931996936,13cyclictest0-21swapper/311:21:363
1931996936,12cyclictest0-21swapper/310:56:503
193099695,57cyclictest0-21swapper/210:22:372
193099695,56cyclictest0-21swapper/209:30:172
193099694,58cyclictest0-21swapper/208:39:352
193099692,60cyclictest30283-21ssh09:06:072
192599693,46cyclictest4013-21latency_hist11:44:480
193199683,57cyclictest569-21ssh08:22:453
193199683,47cyclictest18901-21cat06:50:003
193099685,55cyclictest0-21swapper/210:35:142
193099684,57cyclictest0-21swapper/211:40:122
193099684,57cyclictest0-21swapper/210:45:552
193099684,57cyclictest0-21swapper/210:33:272
193099684,57cyclictest0-21swapper/210:33:272
193099684,57cyclictest0-21swapper/209:41:322
193099684,57cyclictest0-21swapper/209:10:272
193099684,57cyclictest0-21swapper/208:32:332
193099684,56cyclictest22374-21ssh08:55:122
193099684,56cyclictest0-21swapper/210:55:112
192999684,57cyclictest0-21swapper/108:42:191
1931996742,12cyclictest0-21swapper/311:36:483
1931996734,14cyclictest0-21swapper/310:28:113
193199673,47cyclictest1903-21latency_hist06:15:013
193199673,46cyclictest13507-21cat11:09:503
193099675,56cyclictest0-21swapper/209:26:062
193099674,56cyclictest0-21swapper/211:09:232
193099674,56cyclictest0-21swapper/210:14:302
193099674,56cyclictest0-21swapper/208:50:062
193099674,56cyclictest0-21swapper/207:20:182
1929996715,46cyclictest1553-21nscd11:05:021
192599674,55cyclictest0-21swapper/010:55:260
192599674,54cyclictest0-21swapper/010:20:100
1931996638,13cyclictest0-21swapper/309:30:313
193099664,57cyclictest0-21swapper/210:06:012
193099664,56cyclictest0-21swapper/211:10:142
193099664,56cyclictest0-21swapper/211:10:142
193099664,55cyclictest1227-21runrttasks09:22:322
193099664,55cyclictest0-21swapper/207:25:202
1929996621,12cyclictest0-21swapper/108:32:471
1925996638,13cyclictest0-21swapper/010:00:170
1925996637,13cyclictest0-21swapper/007:20:190
193199654,54cyclictest0-21swapper/310:07:333
1931996536,13cyclictest0-21swapper/309:21:533
1931996535,13cyclictest0-21swapper/309:54:103
1931996535,13cyclictest0-21swapper/309:54:103
193199653,55cyclictest13567-21munin-node11:10:113
193199653,55cyclictest13567-21munin-node11:10:113
193099655,54cyclictest0-21swapper/210:43:442
193099655,53cyclictest0-21swapper/211:29:252
193099654,54cyclictest13538-21awk08:40:282
193099654,54cyclictest0-21swapper/211:35:482
193099654,53cyclictest20729-21ssh11:20:072
192999653,54cyclictest5561-21uptime10:55:251
192599654,54cyclictest0-21swapper/008:35:110
192599654,52cyclictest0-21swapper/011:10:160
192599654,52cyclictest0-21swapper/011:10:160
1925996538,12cyclictest0-21swapper/010:35:020
1925996537,13cyclictest0-21swapper/009:24:530
1925996537,13cyclictest0-21swapper/008:25:160
1925996537,13cyclictest0-21swapper/008:25:160
1925996537,12cyclictest0-21swapper/008:30:150
193199644,53cyclictest0-21swapper/310:49:173
1931996437,13cyclictest0-21swapper/310:15:543
1931996437,12cyclictest0-21swapper/310:54:493
1931996436,14cyclictest0-21swapper/308:00:113
193199643,54cyclictest5586-21kworker/3:008:15:323
193099645,53cyclictest0-21swapper/208:23:352
193099645,52cyclictest0-21swapper/210:28:162
193099644,54cyclictest0-21swapper/211:30:252
192999645,53cyclictest0-21swapper/108:57:551
192999644,52cyclictest0-21swapper/107:37:461
192599645,51cyclictest0-21swapper/009:25:150
1925996440,10cyclictest26793-21cut09:50:150
1925996440,10cyclictest26793-21cut09:50:150
1925996431,13cyclictest0-21swapper/009:02:400
193199634,51cyclictest0-21swapper/309:57:263
1931996337,12cyclictest0-21swapper/308:58:473
1931996334,14cyclictest0-21swapper/309:15:273
193099634,53cyclictest0-21swapper/211:15:002
192999634,53cyclictest0-21swapper/110:07:451
192999634,52cyclictest0-21swapper/111:18:231
192999634,52cyclictest0-21swapper/110:53:371
192999634,52cyclictest0-21swapper/108:49:201
192599636,49cyclictest0-21swapper/008:20:140
1925996338,7cyclictest4058-21ssh09:15:240
193199626,50cyclictest0-21swapper/308:43:593
193199626,49cyclictest0-21swapper/310:39:513
193199625,50cyclictest0-21swapper/311:01:033
1931996241,8cyclictest22420-21ssh09:45:063
193199624,51cyclictest0-21swapper/311:30:143
1931996238,9cyclictest32695-21memory09:10:193
1931996236,12cyclictest0-21swapper/310:21:323
1931996235,12cyclictest0-21swapper/307:00:003
193199623,52cyclictest0-21swapper/311:15:003
192599623,52cyclictest0-21swapper/009:10:120
192599623,51cyclictest0-21swapper/007:05:140
210912613,50sleep00-21swapper/008:53:550
193199615,48cyclictest0-21swapper/307:35:123
193199614,50cyclictest0-21swapper/308:50:053
193199614,50cyclictest0-21swapper/307:49:573
193199614,50cyclictest0-21swapper/307:49:573
1931996136,12cyclictest0-21swapper/306:25:263
1931996135,13cyclictest0-21swapper/308:33:143
1931996134,13cyclictest0-21swapper/309:08:243
193199613,52cyclictest0-21swapper/308:25:073
193199613,52cyclictest0-21swapper/308:25:073
193199613,52cyclictest0-21swapper/307:25:103
193199613,51cyclictest9119-21munin-node09:25:073
193199613,51cyclictest18986-21munin-node09:40:203
193099614,52cyclictest0-21swapper/209:16:302
193099613,13cyclictest0-21swapper/209:02:082
192999615,48cyclictest17561-21ssh09:35:281
192999614,50cyclictest29918-21sed09:05:291
192999614,50cyclictest0-21swapper/109:44:491
192999614,49cyclictest1445-21ssh11:40:061
192999613,52cyclictest0-21swapper/110:21:421
1929996122,10cyclictest9028-21df_abs08:35:131
192599615,49cyclictest0-21swapper/011:15:040
192599614,50cyclictest0-21swapper/011:20:070
192599614,50cyclictest0-21swapper/007:30:320
192599614,49cyclictest0-21swapper/010:30:030
192599614,49cyclictest0-21swapper/010:30:030
192599614,49cyclictest0-21swapper/009:34:530
1925996135,12cyclictest0-21swapper/009:05:090
192599613,51cyclictest0-21swapper/011:25:040
192599613,51cyclictest0-21swapper/008:00:180
219499600,4rtkit-daemon2193-21rtkit-daemon08:45:580
193199604,50cyclictest24764-21iostat_ios07:00:233
193199604,50cyclictest24764-21iostat_ios07:00:233
1931996034,12cyclictest0-21swapper/309:00:073
193199603,43cyclictest0-21swapper/308:46:353
192999605,9cyclictest9728-21munin-node10:15:211
192999604,50cyclictest0-21swapper/111:14:421
192999604,50cyclictest0-21swapper/111:14:421
192999604,50cyclictest0-21swapper/111:01:311
192999604,50cyclictest0-21swapper/110:00:241
192999604,50cyclictest0-21swapper/109:49:331
192599604,50cyclictest0-21swapper/007:25:290
192599604,49cyclictest0-21swapper/011:05:080
192599604,49cyclictest0-21swapper/009:35:240
1925996034,12cyclictest0-21swapper/010:14:560
192599603,50cyclictest0-21swapper/007:35:330
192599603,50cyclictest0-21swapper/006:52:050
1925996029,12cyclictest0-21swapper/010:24:530
64882596,9sleep00-21swapper/006:20:580
64882596,9sleep00-21swapper/006:20:580
193199595,48cyclictest0-21swapper/310:10:283
193199595,46cyclictest0-21swapper/306:40:133
1931995938,10cyclictest0-21swapper/308:10:123
1931995933,12cyclictest0-21swapper/309:35:263
193199593,49cyclictest23415-21munin-node11:25:193
193199592,50cyclictest1124-21snmpd07:58:513
1930995919,30cyclictest0-21swapper/207:33:472
192999595,48cyclictest0-21swapper/109:16:341
192999594,50cyclictest0-21swapper/108:19:561
192999594,49cyclictest0-21swapper/109:14:311
192999594,28cyclictest0-21swapper/110:25:121
192999594,28cyclictest0-21swapper/109:34:521
192999593,50cyclictest0-21swapper/107:20:201
192599594,49cyclictest1269-21kworker/0:008:40:080
192599594,49cyclictest0-21swapper/008:55:100
192599593,50cyclictest0-21swapper/010:45:100
192599593,49cyclictest0-21swapper/010:50:220
193199584,48cyclictest6827-21irqstats07:30:213
1931995833,12cyclictest0-21swapper/311:43:063
193199583,48cyclictest1124-21snmpd07:43:493
193099585,14cyclictest0-21swapper/206:27:452
192999584,48cyclictest0-21swapper/110:40:471
192999584,48cyclictest0-21swapper/110:31:411
192999584,48cyclictest0-21swapper/110:31:411
192999584,48cyclictest0-21swapper/108:26:041
192999584,48cyclictest0-21swapper/108:26:041
192999584,37cyclictest26839-21munin-node09:50:161
192999584,37cyclictest26839-21munin-node09:50:161
1929995830,13cyclictest0-21swapper/111:35:571
192599584,48cyclictest0-21swapper/007:54:220
192599584,48cyclictest0-21swapper/006:25:230
1925995835,8cyclictest7036-21ssh11:00:000
1925995830,13cyclictest0-21swapper/011:39:250
192599583,48cyclictest0-21swapper/006:50:000
1925995820,33cyclictest27600-21cpuspeed_turbos08:15:140
193199574,48cyclictest0-21swapper/310:40:253
193199573,49cyclictest0-21swapper/307:07:233
193199573,49cyclictest0-21swapper/306:36:433
193199573,48cyclictest0-21swapper/307:15:313
193199573,48cyclictest0-21swapper/306:22:373
193199573,48cyclictest0-21swapper/306:22:373
193199573,47cyclictest4412-21crond06:20:003
193099574,9cyclictest4375-21ssh08:28:292
193099574,9cyclictest4375-21ssh08:28:292
192999575,46cyclictest0-21swapper/111:30:531
192999573,14cyclictest0-21swapper/109:27:321
192599574,47cyclictest0-21swapper/009:55:050
192599574,46cyclictest0-21swapper/007:45:270
192599574,46cyclictest0-21swapper/007:45:270
192599573,48cyclictest0-21swapper/011:30:020
192599573,48cyclictest0-21swapper/010:42:360
192599573,48cyclictest0-21swapper/006:15:060
192599573,47cyclictest20828-21unixbench_singl09:40:270
1925995728,12cyclictest0-21swapper/007:15:310
1925995723,21cyclictest0-21swapper/010:13:230
1925995715,35cyclictest3662-21sed10:05:080
193199564,45cyclictest8420-21ssh08:34:573
193199563,48cyclictest21967-21kworker/3:110:02:513
193199563,48cyclictest0-21swapper/308:06:473
193199563,47cyclictest29456-21idleruntime07:10:203
193099564,11cyclictest1227-21runrttasks09:55:052
1930995610,30cyclictest0-21swapper/206:30:192
192999564,47cyclictest0-21swapper/109:21:021
192999564,29cyclictest0-21swapper/107:40:221
1925995630,12cyclictest0-21swapper/006:30:210
1925995628,12cyclictest0-21swapper/008:09:550
219499550,5rtkit-daemon2193-21rtkit-daemon08:10:070
219499550,5rtkit-daemon2193-21rtkit-daemon07:55:450
219499550,5rtkit-daemon2193-21rtkit-daemon06:55:400
193199553,7cyclictest10143-21cut06:30:183
193099554,26cyclictest27953-21ssh08:15:182
1930995519,12cyclictest0-21swapper/206:55:122
1930995517,14cyclictest0-21swapper/206:48:392
192999553,30cyclictest0-21swapper/111:20:191
192999553,15cyclictest0-21swapper/110:48:521
219499540,5rtkit-daemon2193-21rtkit-daemon06:40:330
193199543,44cyclictest0-21swapper/307:50:133
193099545,27cyclictest0-21swapper/208:05:092
193099544,27cyclictest0-21swapper/206:15:212
193099543,13cyclictest0-21swapper/207:59:212
192999544,13cyclictest0-21swapper/110:11:431
192999543,46cyclictest0-21swapper/107:55:281
1929995411,21cyclictest0-21swapper/108:05:251
1925995433,10cyclictest0-21swapper/007:00:260
1925995433,10cyclictest0-21swapper/007:00:260
192599543,46cyclictest0-21swapper/007:43:290
193099534,24cyclictest11827-21basename06:35:092
193099534,23cyclictest31056-21aten_r1power_vo07:15:112
1930995315,13cyclictest0-21swapper/207:00:282
1930995315,13cyclictest0-21swapper/207:00:282
192999535,27cyclictest0-21swapper/108:23:151
192999533,44cyclictest0-21swapper/107:10:201
16342535,6sleep00-21swapper/006:11:480
295522522,9sleep00-21swapper/007:10:230
193199522,46cyclictest0-21swapper/306:53:053
193099525,29cyclictest0-21swapper/206:40:332
193099523,26cyclictest0-21swapper/208:10:132
193099522,11cyclictest0-21swapper/207:45:292
193099522,11cyclictest0-21swapper/207:45:292
1930995217,12cyclictest0-21swapper/206:20:232
1930995217,12cyclictest0-21swapper/206:20:232
192999525,28cyclictest0-21swapper/106:38:381
192999524,30cyclictest0-21swapper/107:05:261
192999523,11cyclictest0-21swapper/109:00:061
1929995218,13cyclictest0-21swapper/107:49:571
1929995218,13cyclictest0-21swapper/107:49:571
192599523,43cyclictest0-21swapper/006:35:080
193099515,28cyclictest0-21swapper/207:10:222
193099513,9cyclictest28293-21latency_hist07:09:592
1930995117,12cyclictest0-21swapper/207:50:282
1930995115,14cyclictest0-21swapper/207:40:092
192999514,41cyclictest23919-21iostat10:35:121
192999514,27cyclictest0-21swapper/107:29:581
192999514,26cyclictest0-21swapper/107:00:181
192999514,26cyclictest0-21swapper/107:00:181
192999513,8cyclictest18941-21cat06:50:001
192999513,29cyclictest0-21swapper/106:22:031
192999513,29cyclictest0-21swapper/106:22:031
174462513,42sleep10-21swapper/107:54:221
193099505,29cyclictest0-21swapper/207:38:252
193099503,25cyclictest0-21swapper/206:50:152
192999506,29cyclictest0-21swapper/107:30:241
192999504,23cyclictest3669-21rt-features06:15:291
192999503,41cyclictest0-21swapper/106:40:291
192999503,10cyclictest0-21swapper/106:50:181
1929995022,15cyclictest0-21swapper/106:28:371
1929995017,10cyclictest9644-21egrep06:30:131
1929995013,14cyclictest0-21swapper/108:10:071
192999494,28cyclictest0-21swapper/106:55:361
192999493,12cyclictest0-21swapper/107:15:211
192999493,11cyclictest0-21swapper/108:01:061
192999453,13cyclictest0-21swapper/106:15:011
1930993718,11cyclictest0-21swapper/206:15:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional