You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 18:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Fri Apr 10, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991160,4rtkit-daemon2484-21rtkit-daemon08:49:002
111259910722,25cyclictest18187-21crond10:03:412
2485991030,5rtkit-daemon17087-21latency_hist06:38:503
1112599964,28cyclictest0-21swapper/207:59:152
11125999628,19cyclictest14537-21ssh07:34:002
11125999628,19cyclictest14537-21ssh07:34:002
11125999419,13cyclictest0-21swapper/207:24:192
11125999312,25cyclictest0-21swapper/210:39:142
11125999219,13cyclictest0-21swapper/207:53:592
1112599919,21cyclictest0-21swapper/208:34:082
11125999120,12cyclictest0-21swapper/205:19:032
1112599905,28cyclictest0-21swapper/210:09:122
1112599905,26cyclictest0-21swapper/208:39:042
1112599904,41cyclictest0-21swapper/208:29:012
1112599894,28cyclictest0-21swapper/209:10:092
1112599894,28cyclictest0-21swapper/208:59:022
1112599894,28cyclictest0-21swapper/208:59:022
232012880,3sleep3361ktimersoftd/306:49:133
1112599884,30cyclictest0-21swapper/208:24:132
1112599884,27cyclictest0-21swapper/207:29:192
1112599875,26cyclictest0-21swapper/210:26:092
1112599854,24cyclictest0-21swapper/206:54:012
1112599844,30cyclictest0-21swapper/210:19:112
1112599844,28cyclictest0-21swapper/207:53:482
1112599844,12cyclictest0-21swapper/207:19:172
11125998420,13cyclictest0-21swapper/209:28:232
11125998420,13cyclictest0-21swapper/206:14:212
11125998420,13cyclictest0-21swapper/206:14:212
1112599834,35cyclictest0-21swapper/209:13:592
1112599834,28cyclictest0-21swapper/205:39:122
1112599814,28cyclictest0-21swapper/207:43:582
1112599813,10cyclictest29296-21sshd08:43:572
1112599804,29cyclictest0-21swapper/209:50:282
1112599804,28cyclictest0-21swapper/205:44:192
1112599794,27cyclictest0-21swapper/209:38:432
1112599794,27cyclictest0-21swapper/209:38:432
1112599755,25cyclictest0-21swapper/209:08:112
1112599734,26cyclictest0-21swapper/206:03:302
1112599706,12cyclictest0-21swapper/210:29:442
248599660,4rtkit-daemon2484-21rtkit-daemon08:43:151
11126996647,11cyclictest13970-21gltestperf10:43:593
89982655,14sleep19099-21cut05:14:051
248599650,5rtkit-daemon0-21swapper/306:38:122
1112699655,29cyclictest0-21swapper/308:45:383
1112099654,52cyclictest0-21swapper/007:34:000
1112099654,52cyclictest0-21swapper/007:34:000
153052643,12sleep00-21swapper/008:23:120
153052643,12sleep00-21swapper/008:23:120
1112699644,12cyclictest0-21swapper/310:40:273
11120996449,10cyclictest0-21swapper/009:39:040
11120996448,11cyclictest0-21swapper/009:18:580
211282633,12sleep10-21swapper/107:43:581
11126996312,29cyclictest0-21swapper/305:58:513
11120996344,14cyclictest0-21swapper/007:31:540
1112699625,14cyclictest0-21swapper/310:35:573
1112699623,42cyclictest0-21swapper/307:49:403
11120996244,12cyclictest0-21swapper/009:12:260
9052613,51sleep10-21swapper/108:00:271
1112699615,39cyclictest7482-21munin-node07:24:033
11124996135,12cyclictest0-21swapper/108:52:181
11120996143,13cyclictest0-21swapper/007:43:410
11120996142,13cyclictest0-21swapper/008:39:000
248599600,6rtkit-daemon0-21swapper/306:38:572
11126996022,14cyclictest0-21swapper/307:43:483
1112499603,51cyclictest0-21swapper/110:18:581
1112099605,47cyclictest0-21swapper/010:09:010
11120996043,12cyclictest0-21swapper/007:52:200
11120996042,10cyclictest8384-21aten2.4-expect09:48:520
11120996041,14cyclictest0-21swapper/009:17:580
1112699596,13cyclictest8062-21iostat_ios08:59:063
1112699596,13cyclictest8062-21iostat_ios08:59:063
1112699595,12cyclictest0-21swapper/308:02:573
11126995931,10cyclictest16641-21gltestperf08:24:043
11120995944,10cyclictest0-21swapper/008:47:330
11120995941,13cyclictest0-21swapper/007:20:350
1112699584,14cyclictest0-21swapper/310:13:383
11126995812,28cyclictest0-21swapper/310:00:573
11120995842,11cyclictest0-21swapper/009:08:450
11120995841,12cyclictest0-21swapper/010:04:470
11120995841,12cyclictest0-21swapper/008:24:090
11120995841,12cyclictest0-21swapper/007:27:010
11120995839,13cyclictest0-21swapper/008:14:150
11120995839,13cyclictest0-21swapper/008:14:150
11120995838,13cyclictest0-21swapper/006:54:150
1112699574,37cyclictest0-21swapper/309:46:483
1112699574,36cyclictest0-21swapper/309:36:343
1112699574,36cyclictest0-21swapper/309:36:343
1112699574,14cyclictest0-21swapper/309:24:533
1112699574,13cyclictest0-21swapper/310:20:513
1112699573,37cyclictest0-21swapper/307:35:303
1112699573,37cyclictest0-21swapper/307:35:303
11126995728,12cyclictest0-21swapper/307:29:473
11124995741,11cyclictest0-21swapper/109:59:041
11120995741,11cyclictest0-21swapper/009:47:290
11120995741,11cyclictest0-21swapper/008:49:000
11120995740,12cyclictest0-21swapper/010:17:070
11120995740,12cyclictest0-21swapper/010:17:070
11120995740,12cyclictest0-21swapper/009:24:040
11120995740,12cyclictest0-21swapper/007:57:090
11120995738,13cyclictest0-21swapper/010:28:570
1112099573,49cyclictest0-21swapper/008:31:300
1112099573,30cyclictest0-21swapper/008:59:110
1112099573,30cyclictest0-21swapper/008:59:110
1112699565,31cyclictest0-21swapper/309:19:083
1112699564,45cyclictest0-21swapper/309:58:023
11126995616,20cyclictest29809-21sort07:04:063
11124995642,9cyclictest0-21swapper/110:32:591
1112499564,45cyclictest0-21swapper/109:03:141
1112499564,45cyclictest0-21swapper/109:03:141
11124995637,12cyclictest0-21swapper/107:56:221
11120995641,10cyclictest0-21swapper/009:30:540
11120995640,11cyclictest0-21swapper/009:59:490
1112099564,45cyclictest3762-21ssh08:04:170
1112099564,45cyclictest0-21swapper/010:24:130
11120995639,12cyclictest0-21swapper/010:47:570
11120995638,11cyclictest0-21swapper/010:18:560
11120995637,13cyclictest0-21swapper/010:33:590
11120995637,12cyclictest0-21swapper/009:34:080
11120995637,12cyclictest0-21swapper/009:34:080
195972553,10sleep10-21swapper/108:29:011
1112699557,32cyclictest0-21swapper/310:32:473
1112699554,31cyclictest0-21swapper/306:23:503
1112699554,13cyclictest0-21swapper/308:08:593
11126995539,9cyclictest26135-21sh08:38:563
11126995537,11cyclictest13219-21tail08:19:043
11126995537,11cyclictest13219-21tail08:19:043
11126995536,12cyclictest2570-21cut07:14:073
1112699553,46cyclictest19021-21grep06:39:223
11124995537,12cyclictest0-21swapper/107:39:171
11120995540,11cyclictest0-21swapper/010:43:140
11120995520,12cyclictest0-21swapper/005:47:030
41422543,43sleep10-21swapper/106:09:171
22852540,7chrt0-21swapper/310:27:103
1112699546,34cyclictest0-21swapper/308:34:143
1112699545,33cyclictest0-21swapper/309:14:323
1112699545,30cyclictest0-21swapper/307:54:153
1112699545,14cyclictest0-21swapper/309:41:403
1112699544,36cyclictest0-21swapper/309:49:113
1112699544,30cyclictest0-21swapper/308:04:143
1112699544,30cyclictest0-21swapper/307:09:213
1112699544,29cyclictest0-21swapper/306:58:503
1112699543,36cyclictest0-21swapper/307:47:123
11126995424,13cyclictest0-21swapper/305:49:033
1112599542,38cyclictest0-21swapper/210:05:372
1112499544,26cyclictest9029-21munin-node09:48:591
11124995439,10cyclictest0-21swapper/108:35:241
11124995438,11cyclictest0-21swapper/108:21:351
11124995438,11cyclictest0-21swapper/108:21:351
11124995437,11cyclictest0-21swapper/108:10:251
1112499543,45cyclictest0-21swapper/110:14:031
1112499543,45cyclictest0-21swapper/110:14:031
1112499543,44cyclictest806-21ssh10:24:081
11124995424,25cyclictest0-21swapper/109:39:591
1112099544,43cyclictest0-21swapper/006:24:030
11120995439,8cyclictest14648-21munin-run06:33:500
11120995438,12cyclictest0-21swapper/008:03:170
11120995438,11cyclictest0-21swapper/009:54:130
49022533,8sleep34955-21netstat08:54:113
49022533,8sleep34955-21netstat08:54:113
48432533,9sleep00-21swapper/006:10:370
248712533,9sleep00-21swapper/008:36:140
248599530,4rtkit-daemon2484-21rtkit-daemon08:25:531
232772533,8sleep123290-21munin-node05:44:021
172682533,9sleep00-21swapper/006:38:590
161902533,43sleep00-21swapper/006:34:200
1112699534,30cyclictest0-21swapper/309:09:163
1112699534,30cyclictest0-21swapper/306:44:213
1112699534,30cyclictest0-21swapper/306:14:063
1112699534,30cyclictest0-21swapper/306:14:063
1112699534,29cyclictest0-21swapper/310:13:573
1112699534,29cyclictest0-21swapper/310:13:573
11126995320,15cyclictest0-21swapper/310:07:303
1112699532,36cyclictest0-21swapper/305:33:533
11124995337,10cyclictest27988-21fschecks_time09:29:001
11124995337,10cyclictest0-21swapper/110:11:341
1112499532,44cyclictest18448-21munin-node10:04:091
11120995336,11cyclictest0-21swapper/008:53:560
11120995336,11cyclictest0-21swapper/008:53:560
76062523,42sleep00-21swapper/008:09:450
221142523,42sleep00-21swapper/005:39:180
179632524,9sleep00-21swapper/005:29:550
1112699525,28cyclictest0-21swapper/306:29:153
1112699525,24cyclictest0-21swapper/308:15:283
1112699525,24cyclictest0-21swapper/308:15:283
1112699524,39cyclictest1311-21memory08:49:093
1112699524,29cyclictest0-21swapper/309:31:213
1112699524,29cyclictest0-21swapper/309:04:153
1112699524,29cyclictest0-21swapper/305:18:533
11126995220,14cyclictest0-21swapper/307:19:523
1112599524,42cyclictest0-21swapper/208:19:152
1112599524,42cyclictest0-21swapper/208:19:152
1112599523,20cyclictest0-21swapper/208:15:282
1112599523,20cyclictest0-21swapper/208:15:282
11124995237,9cyclictest13143-21ssh09:07:361
11124995236,12cyclictest0-21swapper/109:20:451
11124995233,12cyclictest0-21swapper/107:49:001
1112499523,43cyclictest13284-21sshd07:30:591
11124995227,19cyclictest23017-21if_eth006:49:091
11124995227,11cyclictest0-21swapper/108:54:021
11124995227,11cyclictest0-21swapper/108:54:021
11124995225,12cyclictest0-21swapper/108:46:491
206252513,42sleep00-21swapper/005:38:330
206252513,42sleep00-21swapper/005:38:330
191312512,10sleep10-21swapper/109:14:491
1112699515,29cyclictest0-21swapper/306:27:173
1112699515,28cyclictest0-21swapper/308:29:153
1112699514,28cyclictest0-21swapper/305:44:093
1112699514,28cyclictest0-21swapper/305:28:543
1112699514,27cyclictest0-21swapper/306:03:523
11126995134,10cyclictest12549-21needreboot05:19:173
1112599514,40cyclictest1419-21runrttasks10:36:392
1112599514,30cyclictest0-21swapper/210:13:572
1112599514,30cyclictest0-21swapper/210:13:572
1112599514,25cyclictest0-21swapper/206:09:022
11124995136,10cyclictest0-21swapper/109:34:421
11124995136,10cyclictest0-21swapper/109:34:421
11124995133,12cyclictest0-21swapper/105:58:511
1112499513,42cyclictest0-21swapper/109:24:101
11120995136,11cyclictest0-21swapper/007:44:080
11120995135,12cyclictest0-21swapper/005:54:210
11120995134,12cyclictest0-21swapper/006:04:160
10752512,43sleep00-21swapper/007:10:390
95792503,9sleep10-21swapper/106:20:101
248599500,5rtkit-daemon2484-21rtkit-daemon08:14:161
248599500,5rtkit-daemon2484-21rtkit-daemon08:14:161
1112699504,29cyclictest0-21swapper/307:02:223
1112699504,29cyclictest0-21swapper/307:02:223
1112699504,28cyclictest0-21swapper/306:09:033
1112699504,16cyclictest0-21swapper/305:39:453
1112699504,14cyclictest0-21swapper/306:07:143
1112599505,26cyclictest0-21swapper/210:43:472
1112599504,39cyclictest0-21swapper/208:11:392
1112599504,28cyclictest0-21swapper/206:24:142
1112599504,27cyclictest0-21swapper/209:29:012
1112599504,24cyclictest0-21swapper/209:38:532
1112599503,33cyclictest0-21swapper/209:21:502
1112499509,33cyclictest0-21swapper/105:59:211
1112499505,39cyclictest10339-21df_inode10:38:551
1112499503,22cyclictest21813-21munin-run06:48:491
11124995025,11cyclictest0-21swapper/109:43:461
11124995019,11cyclictest0-21swapper/110:34:051
1112099503,11cyclictest0-21swapper/006:14:170
1112099503,11cyclictest0-21swapper/006:14:170
97322493,39sleep00-21swapper/006:22:100
160752493,39sleep10-21swapper/110:48:101
1112699494,30cyclictest0-21swapper/305:34:213
1112699494,30cyclictest0-21swapper/305:34:213
1112599495,27cyclictest0-21swapper/208:55:192
1112599495,27cyclictest0-21swapper/208:55:192
1112599494,28cyclictest0-21swapper/206:19:132
1112599494,27cyclictest0-21swapper/205:24:082
1112599493,28cyclictest0-21swapper/208:04:152
1112599493,20cyclictest0-21swapper/207:39:132
11125994920,12cyclictest0-21swapper/206:29:052
1112499494,39cyclictest0-21swapper/107:22:001
1112499494,21cyclictest656-21cpuspeed_turbos06:04:051
1112499493,39cyclictest0-21swapper/109:08:581
277902483,39sleep10-21swapper/105:53:341
277742483,9sleep00-21swapper/005:53:200
1112599484,27cyclictest0-21swapper/209:55:302
1112599484,27cyclictest0-21swapper/209:43:552
1112599484,27cyclictest0-21swapper/206:59:072
1112599484,27cyclictest0-21swapper/206:59:072
1112599484,26cyclictest0-21swapper/206:44:062
1112599484,26cyclictest0-21swapper/206:04:042
1112599484,26cyclictest0-21swapper/205:33:532
11124994834,10cyclictest0-21swapper/107:27:271
11124994830,12cyclictest0-21swapper/105:38:521
11124994830,12cyclictest0-21swapper/105:38:521
11120994830,13cyclictest0-21swapper/005:24:150
11120994830,13cyclictest0-21swapper/005:19:220
1112099483,38cyclictest0-21swapper/006:44:000
11120994820,13cyclictest0-21swapper/007:04:220
313202473,9sleep10-21swapper/107:08:271
287442473,38sleep00-21swapper/007:00:560
287442473,38sleep00-21swapper/007:00:560
239842473,9sleep00-21swapper/006:51:080
119222472,9sleep10-21swapper/106:24:331
1112599474,36cyclictest0-21swapper/205:49:062
1112599474,27cyclictest0-21swapper/206:49:032
1112599474,26cyclictest0-21swapper/207:04:102
1112599473,27cyclictest0-21swapper/205:34:092
1112599473,27cyclictest0-21swapper/205:34:092
1112499479,33cyclictest5922-21forks06:14:071
1112499479,33cyclictest5922-21forks06:14:071
11124994729,12cyclictest0-21swapper/108:07:281
11124994713,29cyclictest15200-21gltestperf07:34:071
11124994713,29cyclictest15200-21gltestperf07:34:071
110272474,6sleep00-21swapper/005:18:060
35902463,37sleep10-21swapper/107:15:241
1112599464,25cyclictest0-21swapper/207:17:242
1112599463,27cyclictest0-21swapper/205:54:172
11125994629,11cyclictest32458-21gltestperf07:09:082
1112499468,34cyclictest0-21swapper/109:54:061
11124994629,12cyclictest0-21swapper/105:19:071
1112099465,15cyclictest0-21swapper/006:03:510
11120994631,11cyclictest0-21swapper/007:14:230
179862452,37sleep10-21swapper/105:30:121
172592453,9sleep10-21swapper/106:38:521
156822453,35sleep10-21swapper/105:26:211
1112499453,37cyclictest32566-21if_eth007:09:091
1112499453,37cyclictest0-21swapper/106:59:221
1112499453,37cyclictest0-21swapper/106:59:221
1112499452,24cyclictest12493-21munin-node06:29:131
11124994512,9cyclictest121850irq/46-eth006:54:101
230002432,36sleep10-21swapper/105:43:221
1112499423,35cyclictest0-21swapper/106:34:161
1112599394,29cyclictest0-21swapper/205:18:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional