You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-24 - 14:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Fri Jul 24, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
133209910836,13cyclictest0-21swapper/210:30:132
133209910537,13cyclictest0-21swapper/208:46:462
133209910537,13cyclictest0-21swapper/208:46:462
133209910134,13cyclictest0-21swapper/210:04:582
13316991013,46cyclictest0-21swapper/009:57:080
13320999937,12cyclictest0-21swapper/211:19:222
13316999939,8cyclictest22862-21kworker/0:108:57:210
219499980,4rtkit-daemon2193-21rtkit-daemon07:58:451
13316999740,9cyclictest5629-21ssh10:41:570
13320999640,12cyclictest0-21swapper/210:49:292
13320999640,12cyclictest0-21swapper/210:49:292
13316999534,13cyclictest0-21swapper/011:01:580
13316999338,9cyclictest929-21kworker/0:011:36:590
13316998834,13cyclictest0-21swapper/011:21:550
13316998022,12cyclictest0-21swapper/010:22:180
219499750,4rtkit-daemon2193-21rtkit-daemon10:40:313
1209027510,55sleep00-21swapper/006:12:130
219499740,6rtkit-daemon2193-21rtkit-daemon09:17:193
219499740,5rtkit-daemon2193-21rtkit-daemon11:12:153
219499740,5rtkit-daemon2193-21rtkit-daemon08:32:363
219499730,4rtkit-daemon2193-21rtkit-daemon08:37:583
219499730,4rtkit-daemon2193-21rtkit-daemon06:32:183
219499720,4rtkit-daemon2193-21rtkit-daemon11:34:523
13320997237,13cyclictest0-21swapper/209:47:022
219499710,5rtkit-daemon2193-21rtkit-daemon10:10:403
219499710,5rtkit-daemon2193-21rtkit-daemon10:10:403
13320997142,13cyclictest0-21swapper/208:27:052
13320997140,14cyclictest0-21swapper/211:01:582
305282700,15sleep31332199cyclictest08:52:053
219499700,4rtkit-daemon2193-21rtkit-daemon07:07:403
219499690,4rtkit-daemon2193-21rtkit-daemon11:44:063
219499690,4rtkit-daemon2193-21rtkit-daemon11:19:523
219499680,5rtkit-daemon2193-21rtkit-daemon06:16:573
219499680,4rtkit-daemon2193-21rtkit-daemon09:49:113
1331899686,54cyclictest0-21swapper/109:40:271
219499670,6rtkit-daemon2193-21rtkit-daemon09:35:493
219499670,5rtkit-daemon2193-21rtkit-daemon10:54:083
219499670,5rtkit-daemon2193-21rtkit-daemon08:21:443
219499670,5rtkit-daemon12926-21grep07:22:093
219499670,5rtkit-daemon12926-21grep07:22:093
219499670,4rtkit-daemon2193-21rtkit-daemon11:03:303
219499670,4rtkit-daemon2193-21rtkit-daemon07:37:383
219499670,4rtkit-daemon2193-21rtkit-daemon06:27:263
13320996738,13cyclictest0-21swapper/210:57:072
219499660,4rtkit-daemon2193-21rtkit-daemon11:01:083
219499660,4rtkit-daemon2193-21rtkit-daemon10:14:023
219499660,4rtkit-daemon2193-21rtkit-daemon10:00:553
13320996536,13cyclictest0-21swapper/210:46:302
13316996533,18cyclictest30060-21ssh10:29:240
1332099644,52cyclictest0-21swapper/209:10:152
13320996436,12cyclictest0-21swapper/209:53:512
1331899645,52cyclictest0-21swapper/111:42:081
1331899644,53cyclictest0-21swapper/108:57:231
219499630,9rtkit-daemon0-21swapper/309:21:573
219499630,9rtkit-daemon0-21swapper/309:21:573
1332099635,50cyclictest0-21swapper/209:32:022
13320996337,12cyclictest0-21swapper/208:25:542
13320996336,12cyclictest0-21swapper/208:35:382
1331899636,50cyclictest0-21swapper/108:37:051
1331899636,49cyclictest0-21swapper/110:32:091
1331899633,25cyclictest0-21swapper/111:12:041
132852636,47sleep20-21swapper/206:16:542
219499620,7rtkit-daemon0-21swapper/311:36:443
219499620,7rtkit-daemon0-21swapper/310:03:033
219499620,7rtkit-daemon0-21swapper/308:21:593
219499620,6rtkit-daemon0-21swapper/310:32:173
219499620,6rtkit-daemon0-21swapper/308:30:363
219499620,12rtkit-daemon2193-21rtkit-daemon10:00:402
1331899625,51cyclictest0-21swapper/109:47:051
1331899625,50cyclictest25048-21unixbench_singl08:42:221
1331899625,50cyclictest25048-21unixbench_singl08:42:221
1331899624,51cyclictest0-21swapper/111:02:011
1331899624,51cyclictest0-21swapper/110:02:051
1331899624,51cyclictest0-21swapper/109:57:011
1331899624,51cyclictest0-21swapper/108:52:131
12322624,12sleep30-21swapper/311:23:213
29192613,50sleep30-21swapper/308:07:193
29192613,50sleep30-21swapper/308:07:193
219499610,4rtkit-daemon31888-21timerwakeupswit06:52:253
219499610,4rtkit-daemon30128-21memory07:57:153
219499610,4rtkit-daemon23799-21perl06:37:113
219499610,4rtkit-daemon1333-21memory06:57:173
219499610,3rtkit-daemon0-21swapper/309:05:203
13320996135,13cyclictest0-21swapper/208:19:502
1331899615,49cyclictest10219-21unixbench-2d10:47:161
1331899615,49cyclictest10219-21unixbench-2d10:47:161
1331899615,49cyclictest0-21swapper/109:22:231
1331899615,49cyclictest0-21swapper/109:22:231
1331899615,49cyclictest0-21swapper/107:12:141
1331899614,50cyclictest0-21swapper/111:34:281
1331899613,8cyclictest31033-21munin-node09:42:021
1331899613,51cyclictest0-21swapper/109:31:331
1331899613,51cyclictest0-21swapper/109:31:331
13316996138,7cyclictest4880-21latency_hist07:06:510
13316996131,13cyclictest0-21swapper/011:32:050
219499600,4rtkit-daemon3748-21iostat_ios07:02:173
219499600,3rtkit-daemon22751-21ssh09:28:493
219499600,3rtkit-daemon22751-21ssh09:28:493
1332099605,49cyclictest0-21swapper/210:52:182
1332099604,49cyclictest0-21swapper/210:36:582
1331899604,50cyclictest0-21swapper/108:48:351
1331899604,49cyclictest0-21swapper/110:57:191
1331899604,49cyclictest0-21swapper/110:43:441
1331899604,49cyclictest0-21swapper/110:11:531
1331899604,49cyclictest0-21swapper/109:17:031
1331899604,49cyclictest0-21swapper/108:22:211
1331899604,49cyclictest0-21swapper/107:31:511
1331899604,48cyclictest0-21swapper/108:32:131
1331899603,50cyclictest0-21swapper/108:12:181
1331899603,10cyclictest0-21swapper/109:32:101
1331699603,48cyclictest0-21swapper/009:47:090
13320995936,11cyclictest0-21swapper/211:22:232
13320995935,11cyclictest0-21swapper/210:36:292
1331899595,48cyclictest0-21swapper/110:07:541
1331899595,48cyclictest0-21swapper/110:07:541
1331899595,47cyclictest0-21swapper/110:55:201
1331899595,46cyclictest5809-21missed_timers09:52:091
1331899595,37cyclictest2248-21ssh11:26:411
1331899594,48cyclictest0-21swapper/111:37:071
1331899594,48cyclictest0-21swapper/111:27:251
1331899594,48cyclictest0-21swapper/111:27:251
1331899594,48cyclictest0-21swapper/110:27:071
1331899594,48cyclictest0-21swapper/109:14:441
1331899594,48cyclictest0-21swapper/109:02:061
13316995939,14cyclictest0-21swapper/010:57:300
13316995936,8cyclictest20432-21ssh08:37:030
174802583,8sleep017484-21ssh10:11:420
174802583,8sleep017484-21ssh10:11:420
1332099585,30cyclictest0-21swapper/207:33:482
13320995833,11cyclictest0-21swapper/211:11:592
13320995832,10cyclictest0-21swapper/211:36:522
1331899584,48cyclictest0-21swapper/109:09:501
1331899584,47cyclictest14532-21sed08:27:211
13316995838,12cyclictest0-21swapper/010:17:140
1332199574,45cyclictest0-21swapper/309:12:113
1332099574,36cyclictest0-21swapper/210:09:532
1332099574,36cyclictest0-21swapper/210:09:532
13320995736,8cyclictest5606-21python09:02:232
13320995735,10cyclictest0-21swapper/210:14:382
13320995733,11cyclictest0-21swapper/209:24:552
13320995733,11cyclictest0-21swapper/209:24:552
13320995722,15cyclictest0-21swapper/208:47:072
1332099572,36cyclictest0-21swapper/209:14:572
1331899575,47cyclictest0-21swapper/110:41:251
1331899575,45cyclictest0-21swapper/108:17:141
1331899574,47cyclictest0-21swapper/107:36:511
13316995735,15cyclictest0-21swapper/009:32:060
1331699573,47cyclictest0-21swapper/008:47:210
51862564,46sleep30-21swapper/311:30:223
51862564,46sleep30-21swapper/311:30:223
251842562,47sleep00-21swapper/008:42:440
251842562,47sleep00-21swapper/008:42:440
219499560,3rtkit-daemon23950-21sh11:08:533
1332099564,47cyclictest0-21swapper/209:43:002
1332099564,46cyclictest0-21swapper/208:38:042
13320995633,10cyclictest0-21swapper/208:57:102
13316995636,13cyclictest0-21swapper/006:56:520
234102555,10sleep10-21swapper/110:19:081
1332099555,36cyclictest0-21swapper/208:54:592
1332099554,28cyclictest0-21swapper/206:27:042
13320995533,10cyclictest0-21swapper/211:42:432
1331899554,44cyclictest0-21swapper/110:22:091
13316995540,10cyclictest0-21swapper/008:52:070
13316995539,9cyclictest8583-21rm10:46:550
13316995539,9cyclictest8583-21rm10:46:550
13316995537,12cyclictest0-21swapper/009:07:040
13316995536,13cyclictest0-21swapper/010:56:430
13316995536,12cyclictest0-21swapper/011:41:560
13316995535,14cyclictest0-21swapper/007:57:080
13316995533,8cyclictest12451-21ssh09:12:200
1331699553,46cyclictest0-21swapper/008:33:570
1331699553,44cyclictest0-21swapper/009:21:590
1331699553,44cyclictest0-21swapper/009:21:590
13316995527,13cyclictest0-21swapper/010:32:040
295312543,43sleep20-21swapper/207:57:062
232272543,12sleep30-21swapper/310:18:263
219499540,5rtkit-daemon2193-21rtkit-daemon09:07:203
219499540,4rtkit-daemon2193-21rtkit-daemon07:55:233
1332199545,28cyclictest0-21swapper/307:51:493
1332099545,29cyclictest0-21swapper/206:42:262
1332099545,29cyclictest0-21swapper/206:42:262
1332099544,44cyclictest0-21swapper/209:17:592
1332099544,29cyclictest0-21swapper/210:22:182
13320995434,7cyclictest5396-21ssh11:31:102
13320995434,7cyclictest5396-21ssh11:31:102
1332099543,27cyclictest0-21swapper/207:16:072
13320995420,13cyclictest0-21swapper/208:10:172
13320995420,13cyclictest0-21swapper/208:10:172
1331899545,27cyclictest0-21swapper/107:25:181
1331899545,27cyclictest0-21swapper/107:25:181
1331899544,44cyclictest29282-21iostat11:17:061
1331899543,8cyclictest22128-21munin-node06:32:231
13318995423,8cyclictest0-21swapper/106:37:171
13318995415,33cyclictest1547-21nscd11:06:551
1331699544,43cyclictest0-21swapper/010:12:130
13316995437,11cyclictest0-21swapper/009:27:300
13316995437,11cyclictest0-21swapper/009:27:300
13316995435,13cyclictest0-21swapper/008:22:200
13316995426,13cyclictest0-21swapper/008:27:240
1332199535,14cyclictest0-21swapper/309:01:103
1332199533,35cyclictest0-21swapper/308:45:173
1332199533,35cyclictest0-21swapper/308:45:173
13321995321,12cyclictest0-21swapper/310:31:433
1332099535,29cyclictest0-21swapper/211:06:542
1332099535,29cyclictest0-21swapper/207:37:182
1332099535,29cyclictest0-21swapper/206:47:212
1332099535,28cyclictest0-21swapper/208:02:162
1332099535,28cyclictest0-21swapper/208:02:162
1332099534,30cyclictest0-21swapper/207:52:062
1332099534,29cyclictest0-21swapper/207:47:212
1332099534,28cyclictest0-21swapper/206:37:072
13320995331,10cyclictest0-21swapper/209:26:592
13320995331,10cyclictest0-21swapper/209:26:592
13320995319,14cyclictest0-21swapper/209:37:252
1331899534,9cyclictest11099-21uname07:17:181
1331899534,27cyclictest0-21swapper/106:57:141
1331899533,10cyclictest0-21swapper/107:47:151
1331699534,42cyclictest0-21swapper/009:42:030
13316995338,9cyclictest20696-21munin-node06:32:200
13316995335,12cyclictest0-21swapper/008:17:100
13316995316,32cyclictest0-21swapper/011:19:590
74602522,9sleep30-21swapper/307:11:533
60362522,9sleep20-21swapper/208:16:462
320382523,42sleep10-21swapper/106:52:281
285822524,9sleep10-21swapper/107:54:361
262852522,44sleep00-21swapper/007:50:440
1332199525,30cyclictest0-21swapper/310:22:163
13321995223,11cyclictest0-21swapper/309:43:443
1332099525,28cyclictest0-21swapper/211:32:112
1332099525,28cyclictest0-21swapper/210:20:542
1332099525,26cyclictest1633-21yum-updatesd-he06:57:272
1332099524,29cyclictest0-21swapper/206:52:202
1331899524,26cyclictest0-21swapper/107:42:241
13318995237,9cyclictest16521-21cut06:22:131
1331699524,41cyclictest0-21swapper/011:07:070
13316995239,8cyclictest27621-21munin-run06:46:520
13316995239,8cyclictest27621-21munin-run06:46:520
13316995236,9cyclictest28715-21grep06:47:120
13316995234,12cyclictest0-21swapper/011:27:180
13316995234,12cyclictest0-21swapper/011:27:180
1331699523,41cyclictest0-21swapper/006:57:170
13316995218,27cyclictest0-21swapper/010:02:020
66452512,9sleep00-21swapper/009:05:060
219499510,5rtkit-daemon2193-21rtkit-daemon10:44:243
166272512,43sleep30-21swapper/307:29:183
1332199515,28cyclictest0-21swapper/310:47:173
1332199515,28cyclictest0-21swapper/310:47:173
1332199515,28cyclictest0-21swapper/306:47:213
1332199515,26cyclictest4605-21munin-node09:52:053
13321995121,12cyclictest0-21swapper/308:12:093
13321995120,13cyclictest0-21swapper/308:02:123
13321995120,13cyclictest0-21swapper/308:02:123
13321995117,10cyclictest28786-21cat09:37:193
1332099515,27cyclictest0-21swapper/206:17:072
13316995134,12cyclictest0-21swapper/010:38:270
179552502,9sleep30-21swapper/306:25:293
1332199504,28cyclictest0-21swapper/307:32:213
1332099505,26cyclictest0-21swapper/207:22:222
1332099505,26cyclictest0-21swapper/207:22:222
1332099504,28cyclictest0-21swapper/207:05:142
1332099504,27cyclictest0-21swapper/207:27:032
13316995039,6cyclictest7290-21ssh09:55:270
1331699503,40cyclictest0-21swapper/009:37:010
1331699503,40cyclictest0-21swapper/009:17:060
30142493,40sleep13110-21munin-node08:07:211
30142493,40sleep13110-21munin-node08:07:211
1332199494,28cyclictest0-21swapper/307:45:213
1332199494,27cyclictest0-21swapper/308:47:493
1332199494,27cyclictest0-21swapper/307:17:243
1332099493,28cyclictest0-21swapper/207:07:152
13320994919,12cyclictest0-21swapper/207:42:112
13320994918,13cyclictest0-21swapper/206:32:052
1331899494,25cyclictest19136-21gltestperf06:27:131
13318994910,35cyclictest4889-21awk07:06:511
1331699494,39cyclictest0-21swapper/007:21:140
13316994933,11cyclictest0-21swapper/011:14:530
252172483,39sleep00-21swapper/006:41:470
1332099482,42cyclictest0-21swapper/207:21:392
1331899485,38cyclictest0-21swapper/106:46:521
1331899485,38cyclictest0-21swapper/106:46:521
1331899485,36cyclictest14350-21gltestperf06:17:131
13316994832,11cyclictest0-21swapper/008:02:060
13316994832,11cyclictest0-21swapper/008:02:060
13316994831,12cyclictest0-21swapper/007:52:050
13316994831,12cyclictest0-21swapper/007:09:100
13316994831,12cyclictest0-21swapper/006:27:370
13316994831,12cyclictest0-21swapper/006:21:410
1331699483,38cyclictest0-21swapper/007:12:100
1331699483,37cyclictest0-21swapper/007:22:030
1331699483,37cyclictest0-21swapper/007:22:030
33092472,10sleep00-21swapper/008:07:370
33092472,10sleep00-21swapper/008:07:370
191092472,38sleep00-21swapper/007:35:320
1331899474,28cyclictest0-21swapper/107:37:231
13316994732,9cyclictest41ktimersoftd/007:37:200
13316994731,11cyclictest0-21swapper/007:42:020
13316994730,12cyclictest0-21swapper/006:23:170
1331699473,38cyclictest15546-21grep07:27:100
1332099463,26cyclictest0-21swapper/206:22:192
1331899464,37cyclictest0-21swapper/107:07:221
1331899463,11cyclictest0-21swapper/106:51:491
13316994630,9cyclictest4214-21cpuspeed_turbos08:12:020
1332199454,25cyclictest0-21swapper/306:42:073
1332199454,25cyclictest0-21swapper/306:42:073
1331899455,35cyclictest0-21swapper/108:03:041
1331899455,35cyclictest0-21swapper/108:03:041
13318994224,10cyclictest1227-21runrttasks06:16:551
1332199414,29cyclictest0-21swapper/306:16:553
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional