You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-16 - 23:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Wed Sep 16, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1209321240,11sleep22873099cyclictest09:36:232
287289910442,14cyclictest0-21swapper/009:31:090
219499990,5rtkit-daemon0-21swapper/105:26:301
246292850,3sleep1201ktimersoftd/110:45:561
28731997717,53cyclictest8767-21munin-node09:51:103
28731997717,53cyclictest8767-21munin-node09:51:103
28731997515,53cyclictest24050-21missed_timers08:16:253
212112750,5sleep1201ktimersoftd/109:51:131
212112750,5sleep1201ktimersoftd/109:51:131
2872999733,48cyclictest6823-21latency_hist08:41:021
2872999703,61cyclictest0-21swapper/110:40:041
2873199694,11cyclictest24682-21missed_timers09:06:223
2872999685,14cyclictest0-21swapper/107:41:371
2872999674,54cyclictest0-21swapper/110:51:301
219499670,25rtkit-daemon0-21swapper/005:27:452
2873199664,12cyclictest27599-21fschecks_time09:11:183
2872999664,55cyclictest0-21swapper/109:23:431
2872999655,52cyclictest0-21swapper/110:35:131
2872999655,52cyclictest0-21swapper/110:35:131
2872999654,53cyclictest0-21swapper/109:50:101
28729996524,13cyclictest0-21swapper/108:56:201
2872999646,15cyclictest0-21swapper/110:14:561
2872999644,53cyclictest0-21swapper/107:51:501
2872999644,53cyclictest0-21swapper/107:51:501
2872999644,52cyclictest0-21swapper/108:01:171
219499640,23rtkit-daemon2193-21rtkit-daemon10:20:413
28731996343,14cyclictest0-21swapper/309:46:213
2872999635,51cyclictest0-21swapper/107:35:341
2872999634,52cyclictest0-21swapper/108:50:321
2872999634,51cyclictest0-21swapper/107:50:361
2872999634,50cyclictest0-21swapper/108:31:011
2872999633,54cyclictest0-21swapper/110:25:201
2873199623,52cyclictest0-21swapper/307:59:333
2872999624,39cyclictest0-21swapper/109:20:591
2872999624,39cyclictest0-21swapper/109:20:591
2872999623,53cyclictest0-21swapper/110:26:541
2872999623,53cyclictest0-21swapper/109:57:161
2872999623,53cyclictest0-21swapper/109:12:021
2872999623,53cyclictest0-21swapper/108:21:221
2872999623,52cyclictest0-21swapper/109:06:261
2872999623,51cyclictest0-21swapper/106:06:191
64612613,50sleep00-21swapper/010:16:250
2873199614,51cyclictest0-21swapper/308:45:303
2873199612,53cyclictest0-21swapper/307:49:203
2873099614,12cyclictest0-21swapper/209:16:292
2873099614,12cyclictest0-21swapper/209:16:292
28730996111,28cyclictest0-21swapper/209:43:302
2872999615,48cyclictest0-21swapper/109:01:121
2872999614,51cyclictest0-21swapper/108:31:341
2872999614,51cyclictest0-21swapper/108:31:341
2872999613,51cyclictest21309-21sed08:11:351
28728996122,23cyclictest0-21swapper/008:31:260
28728996122,23cyclictest0-21swapper/008:31:260
26042612,10sleep00-21swapper/009:21:300
2873199603,51cyclictest0-21swapper/310:21:583
28730996030,22cyclictest0-21swapper/208:06:352
2872999604,51cyclictest0-21swapper/110:05:581
2872999604,49cyclictest0-21swapper/110:16:191
2872999604,48cyclictest0-21swapper/107:11:331
2872999604,48cyclictest0-21swapper/105:56:201
2872999604,16cyclictest0-21swapper/108:54:451
2872999603,50cyclictest0-21swapper/109:36:111
2872999603,50cyclictest0-21swapper/107:26:431
2872999603,49cyclictest11357-21sed07:01:371
28729996019,13cyclictest1227-21runrttasks08:42:191
28728996040,13cyclictest0-21swapper/009:08:450
2873199594,40cyclictest34-21rcuc/308:01:293
2873199593,49cyclictest0-21swapper/309:25:313
28731995922,32cyclictest0-21swapper/310:41:213
2873199592,51cyclictest0-21swapper/309:40:523
2873199592,51cyclictest0-21swapper/308:51:473
2873099594,47cyclictest0-21swapper/208:21:122
2873099593,42cyclictest0-21swapper/210:09:302
2872999594,48cyclictest0-21swapper/110:06:081
2872999594,28cyclictest0-21swapper/107:38:021
2872999593,50cyclictest0-21swapper/109:41:071
28729995924,18cyclictest0-21swapper/109:34:311
28728995939,13cyclictest0-21swapper/009:51:200
28728995939,13cyclictest0-21swapper/009:51:200
28728995937,14cyclictest0-21swapper/010:26:400
64442583,46sleep00-21swapper/007:51:150
64442583,46sleep00-21swapper/007:51:150
2873199582,51cyclictest0-21swapper/310:12:093
2873199582,50cyclictest0-21swapper/308:24:583
28731995817,12cyclictest0-21swapper/309:41:213
28730995844,8cyclictest9972-21ssh09:33:062
2873099584,13cyclictest0-21swapper/208:01:272
2873099583,11cyclictest0-21swapper/208:36:222
2872999584,33cyclictest0-21swapper/105:36:281
2872999584,28cyclictest0-21swapper/110:46:311
2872999583,49cyclictest0-21swapper/108:09:461
2872999583,49cyclictest0-21swapper/106:21:211
2872999583,48cyclictest5146-21munin-node05:41:361
2872999583,48cyclictest0-21swapper/106:01:181
28729995823,10cyclictest0-21swapper/108:17:121
293872572,9sleep00-21swapper/009:14:200
2873199574,48cyclictest0-21swapper/308:08:543
28731995720,12cyclictest0-21swapper/310:26:593
2873199572,49cyclictest0-21swapper/307:26:123
28731995717,23cyclictest29028-21timerandwakeup10:01:303
28731995715,13cyclictest0-21swapper/310:08:543
28731995712,17cyclictest21457-21crond07:26:033
28730995740,10cyclictest4285-21grep06:46:352
28730995734,8cyclictest23248-21ssh08:16:152
28730995730,11cyclictest10505-21telnet08:46:132
2873099573,47cyclictest0-21swapper/207:36:022
2873099573,46cyclictest3710-21grep07:46:222
2872999573,48cyclictest28749-21latency_hist05:26:091
2872999573,47cyclictest7907-21df_abs06:56:211
2872999573,47cyclictest0-21swapper/106:51:211
28729995718,13cyclictest0-21swapper/106:11:191
28728995737,13cyclictest0-21swapper/009:20:590
28728995737,13cyclictest0-21swapper/009:20:590
28728995727,14cyclictest0-21swapper/008:36:170
28728995723,13cyclictest0-21swapper/006:16:240
70662563,11sleep20-21swapper/208:41:082
28731995640,12cyclictest0-21swapper/310:36:243
2873199564,47cyclictest0-21swapper/308:12:123
2873199564,27cyclictest0-21swapper/309:29:133
2873199563,46cyclictest25066-21ssh07:31:153
2873199563,46cyclictest0-21swapper/306:01:173
2873199563,36cyclictest0-21swapper/307:51:283
2873199563,36cyclictest0-21swapper/307:51:283
2873199563,24cyclictest0-21swapper/309:31:103
28731995623,15cyclictest0-21swapper/306:11:273
2873199562,49cyclictest0-21swapper/309:01:453
2873199562,49cyclictest0-21swapper/308:57:343
2873099563,9cyclictest19266-21latency10:36:202
2872999564,46cyclictest0-21swapper/109:26:451
2872999563,47cyclictest0-21swapper/105:31:281
2872999563,46cyclictest21668-21cat07:26:051
28729995621,15cyclictest0-21swapper/107:16:251
28729995621,15cyclictest0-21swapper/107:16:251
28728995637,13cyclictest0-21swapper/009:49:360
28728995637,13cyclictest0-21swapper/009:43:390
219499560,5rtkit-daemon2193-21rtkit-daemon05:46:292
219499560,5rtkit-daemon2193-21rtkit-daemon05:46:292
219499560,4rtkit-daemon2193-21rtkit-daemon05:42:302
307372554,11sleep30-21swapper/310:54:463
2873199554,27cyclictest31821-21munin-node07:41:353
2873199554,14cyclictest0-21swapper/305:54:433
2873199554,13cyclictest0-21swapper/306:31:173
2873199554,13cyclictest0-21swapper/306:31:173
28731995523,12cyclictest0-21swapper/305:31:353
2873199552,49cyclictest0-21swapper/308:29:083
28731995516,12cyclictest0-21swapper/308:46:353
2873099554,46cyclictest0-21swapper/210:22:312
28730995530,9cyclictest30551-21ssh08:26:232
28730995529,8cyclictest20935-21ssh09:01:182
28730995517,19cyclictest0-21swapper/209:00:212
2872999554,43cyclictest0-21swapper/107:56:321
2872999553,45cyclictest13132-21if_eth007:06:261
28728995541,9cyclictest0-21swapper/010:36:300
28728995540,9cyclictest11318-21wc07:56:360
28728995538,11cyclictest0-21swapper/010:45:550
28728995536,12cyclictest0-21swapper/008:46:160
28728995536,12cyclictest0-21swapper/008:07:250
28728995535,14cyclictest0-21swapper/010:21:200
263412553,45sleep326427-21latency06:26:283
219499550,6rtkit-daemon2193-21rtkit-daemon07:01:342
159182554,45sleep20-21swapper/208:53:062
2873199545,27cyclictest0-21swapper/306:54:533
2873199545,14cyclictest0-21swapper/310:46:143
2873199545,14cyclictest0-21swapper/307:39:493
2873199544,12cyclictest0-21swapper/309:17:343
2873199544,12cyclictest0-21swapper/309:17:343
28731995422,14cyclictest0-21swapper/307:11:393
28731995422,12cyclictest0-21swapper/310:32:503
28731995422,12cyclictest0-21swapper/310:32:503
28731995421,13cyclictest0-21swapper/305:36:343
2873199542,47cyclictest0-21swapper/309:56:423
28731995417,11cyclictest12755-21grep05:56:403
2873099544,11cyclictest0-21swapper/210:18:292
2873099543,43cyclictest0-21swapper/210:41:182
28730995427,8cyclictest21467-21diskmemload07:36:362
2872999544,30cyclictest0-21swapper/105:49:431
2872999544,30cyclictest0-21swapper/105:49:431
2872899546,41cyclictest0-21swapper/010:11:090
28728995439,10cyclictest0-21swapper/010:04:060
28728995438,9cyclictest11485-21grep07:01:380
28728995435,13cyclictest0-21swapper/006:21:180
238102542,10sleep20-21swapper/209:55:512
238102542,10sleep20-21swapper/209:55:512
224052543,12sleep20-21swapper/208:15:162
219499540,5rtkit-daemon2193-21rtkit-daemon10:31:112
219499540,5rtkit-daemon2193-21rtkit-daemon10:31:112
219499540,5rtkit-daemon2193-21rtkit-daemon08:36:003
219499540,5rtkit-daemon2193-21rtkit-daemon08:36:003
219499540,5rtkit-daemon2193-21rtkit-daemon06:21:282
219499540,5rtkit-daemon2193-21rtkit-daemon05:56:362
219499540,5rtkit-daemon2193-21rtkit-daemon05:51:372
139432542,45sleep00-21swapper/009:40:450
106412543,10sleep20-21swapper/207:56:252
319072533,44sleep231929-21grep05:31:252
2873199535,30cyclictest0-21swapper/306:08:543
2873199533,45cyclictest0-21swapper/308:36:123
2873199533,27cyclictest0-21swapper/307:06:173
2873099534,6cyclictest30429-21crond10:05:572
28730995328,9cyclictest7829-21ssh07:51:322
28730995328,9cyclictest7829-21ssh07:51:322
28730995324,12cyclictest0-21swapper/209:21:582
28728995339,10cyclictest0-21swapper/008:13:140
28728995338,10cyclictest0-21swapper/009:29:060
28728995324,13cyclictest0-21swapper/007:41:340
28728995324,12cyclictest0-21swapper/008:01:240
219499530,5rtkit-daemon2193-21rtkit-daemon10:51:022
219499530,5rtkit-daemon2193-21rtkit-daemon10:46:102
219499530,5rtkit-daemon2193-21rtkit-daemon06:16:282
208242533,43sleep020928-21tune2fs09:01:180
305282523,43sleep130668-21df_inode06:36:221
2873199525,28cyclictest0-21swapper/306:56:253
2873199525,14cyclictest0-21swapper/305:26:213
2873199523,25cyclictest0-21swapper/306:21:363
2873099524,28cyclictest0-21swapper/206:41:282
2873099524,10cyclictest0-21swapper/208:31:072
2873099524,10cyclictest0-21swapper/208:31:072
28730995235,12cyclictest0-21swapper/210:11:202
28730995231,7cyclictest24734-21munin-run07:31:032
28730995231,13cyclictest0-21swapper/209:56:242
28730995228,9cyclictest15851-21telnet06:06:152
28730995227,8cyclictest28300-21rm09:11:292
28730995223,12cyclictest0-21swapper/209:26:162
2872999524,28cyclictest0-21swapper/106:46:251
2872999523,29cyclictest0-21swapper/106:16:361
2872899524,40cyclictest0-21swapper/010:06:270
2872899524,39cyclictest0-21swapper/007:21:130
2872899524,29cyclictest0-21swapper/005:31:300
2872899524,19cyclictest0-21swapper/007:29:290
28728995238,10cyclictest0-21swapper/008:29:540
28728995237,10cyclictest0-21swapper/008:41:110
219499520,5rtkit-daemon2193-21rtkit-daemon10:26:112
219499520,5rtkit-daemon2193-21rtkit-daemon07:16:032
219499520,5rtkit-daemon2193-21rtkit-daemon06:51:192
219499520,5rtkit-daemon2193-21rtkit-daemon06:31:052
219499520,5rtkit-daemon2193-21rtkit-daemon06:11:362
178662522,9sleep00-21swapper/008:56:220
320472512,9sleep00-21swapper/006:38:350
2873199515,27cyclictest20591-21aten2.4-expect06:16:183
2873199515,27cyclictest0-21swapper/307:04:553
2873199514,28cyclictest0-21swapper/307:16:163
2873199514,28cyclictest0-21swapper/307:16:163
2873199513,26cyclictest0-21swapper/305:46:373
2873199513,26cyclictest0-21swapper/305:46:373
2873099513,41cyclictest0-21swapper/209:09:002
28728995139,8cyclictest15862-21if_err_eth010:31:180
28728995139,8cyclictest15862-21if_err_eth010:31:180
2872899513,44cyclictest0-21swapper/008:20:430
2872899513,43cyclictest0-21swapper/009:57:230
28728995125,12cyclictest0-21swapper/007:46:270
219499510,4rtkit-daemon2193-21rtkit-daemon06:36:202
201392510,13sleep22873099cyclictest09:49:172
157392512,42sleep00-21swapper/008:52:230
154382512,42sleep00-21swapper/006:05:050
2873199504,29cyclictest0-21swapper/305:41:413
2873099504,27cyclictest0-21swapper/207:41:232
28730995019,14cyclictest0-21swapper/207:06:262
2872999503,41cyclictest0-21swapper/105:53:051
2872999503,40cyclictest0-21swapper/106:45:301
28728995023,12cyclictest0-21swapper/005:36:200
28728995021,12cyclictest0-21swapper/008:24:050
28728995021,12cyclictest0-21swapper/007:36:270
28728995012,12cyclictest0-21swapper/007:33:280
219499500,4rtkit-daemon2193-21rtkit-daemon06:31:202
219499500,4rtkit-daemon2193-21rtkit-daemon06:31:202
20902502,41sleep00-21swapper/006:43:270
58312492,9sleep00-21swapper/005:44:170
2873199492,43cyclictest0-21swapper/306:36:183
2873099493,27cyclictest0-21swapper/206:59:572
2872999495,36cyclictest0-21swapper/106:31:351
2872999495,36cyclictest0-21swapper/106:31:351
2872899495,21cyclictest0-21swapper/006:49:530
2872899494,38cyclictest0-21swapper/010:46:320
2872899494,28cyclictest0-21swapper/010:54:340
2872899494,28cyclictest0-21swapper/006:31:290
2872899494,28cyclictest0-21swapper/006:31:290
142732492,41sleep00-21swapper/007:10:560
2873199484,24cyclictest937-21hddtemp_smartct06:41:253
28731994813,14cyclictest0-21swapper/306:46:333
2872899484,36cyclictest0-21swapper/006:51:170
2872899484,27cyclictest0-21swapper/005:26:300
219499480,4rtkit-daemon2193-21rtkit-daemon07:16:262
219499480,4rtkit-daemon2193-21rtkit-daemon07:16:262
80432472,9sleep00-21swapper/005:46:590
80432472,9sleep00-21swapper/005:46:590
2873099472,39cyclictest13367-21munin-node06:01:392
2872999473,10cyclictest0-21swapper/106:26:161
2872899474,25cyclictest0-21swapper/006:26:370
28728994732,10cyclictest0-21swapper/005:51:210
2872899473,37cyclictest0-21swapper/005:56:180
28728994721,12cyclictest14549-21telnet07:11:150
28728994718,12cyclictest0-21swapper/006:11:180
28728994631,11cyclictest0-21swapper/007:18:450
28728994631,11cyclictest0-21swapper/007:18:450
28728994616,13cyclictest0-21swapper/006:56:370
2873099453,35cyclictest0-21swapper/205:36:282
157552452,36sleep00-21swapper/006:06:140
2873099443,26cyclictest0-21swapper/207:24:582
28731994318,9cyclictest28883-21cat05:26:093
28730993712,10cyclictest7150irq/45-ahci05:26:092
2872899373,29cyclictest0-21swapper/005:26:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional