You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-05 - 08:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Wed Aug 05, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991050,4rtkit-daemon2193-21rtkit-daemon22:37:420
4931991033,47cyclictest0-21swapper/021:14:150
4931991016,38cyclictest0-21swapper/019:47:080
4931999824,13cyclictest0-21swapper/023:32:030
493199963,37cyclictest0-21swapper/022:19:370
493199944,42cyclictest0-21swapper/020:26:310
4931999437,14cyclictest0-21swapper/022:11:190
493199924,27cyclictest0-21swapper/020:51:150
4931999237,13cyclictest0-21swapper/021:56:070
493199914,27cyclictest0-21swapper/020:56:240
493199913,35cyclictest0-21swapper/019:07:270
493199904,34cyclictest0-21swapper/022:52:570
219499900,4rtkit-daemon2193-21rtkit-daemon22:56:563
493199895,29cyclictest0-21swapper/023:26:160
493199894,41cyclictest0-21swapper/022:46:040
493199894,41cyclictest0-21swapper/022:46:040
493199894,37cyclictest0-21swapper/018:46:270
493199894,37cyclictest0-21swapper/018:46:270
493199894,29cyclictest0-21swapper/020:46:250
4931998736,13cyclictest0-21swapper/020:31:290
493199872,36cyclictest2214-21ssh21:49:400
219499870,6rtkit-daemon2193-21rtkit-daemon22:28:352
493199854,12cyclictest0-21swapper/020:14:590
493199854,12cyclictest0-21swapper/020:14:590
493199844,40cyclictest0-21swapper/020:41:190
493199844,27cyclictest0-21swapper/023:11:100
493199833,36cyclictest0-21swapper/021:33:420
4931998138,9cyclictest0-21swapper/021:19:580
219499770,5rtkit-daemon2193-21rtkit-daemon20:31:092
4933997625,28cyclictest4085-21head21:51:232
493199744,26cyclictest0-21swapper/023:16:080
219499740,4rtkit-daemon2193-21rtkit-daemon22:02:062
4933997315,48cyclictest0-21swapper/220:47:052
219499730,13rtkit-daemon2193-21rtkit-daemon23:09:410
4933997124,40cyclictest16929-21cpuspeed_turbos23:01:102
4933997023,28cyclictest14308-21munin-node22:56:162
4933997019,35cyclictest0-21swapper/220:06:332
4933997019,35cyclictest0-21swapper/220:06:332
4933996924,38cyclictest7360-21grep19:16:232
4933996916,46cyclictest0-21swapper/222:34:272
4933996916,45cyclictest0-21swapper/223:11:282
4933996816,20cyclictest0-21swapper/221:11:272
219499680,4rtkit-daemon2193-21rtkit-daemon23:23:471
4933996721,26cyclictest3104-21nscd20:25:592
4933996718,42cyclictest0-21swapper/221:16:552
4933996716,43cyclictest0-21swapper/221:31:212
4933996716,35cyclictest0-21swapper/222:16:222
4933996713,34cyclictest0-21swapper/222:11:182
255422670,3sleep041ktimersoftd/022:25:560
219499670,5rtkit-daemon2193-21rtkit-daemon23:24:250
4933996637,12cyclictest0-21swapper/222:21:212
4933996628,15cyclictest1227-21runrttasks23:19:002
4933996621,38cyclictest4295-21cpuspeed_turbos23:31:102
4933996619,29cyclictest18709-21ssh20:36:162
4933996619,25cyclictest1124-21snmpd21:22:302
4933996617,42cyclictest0-21swapper/221:06:042
4933996616,43cyclictest0-21swapper/222:44:252
4933996616,33cyclictest0-21swapper/223:10:102
4933996614,45cyclictest29944-21diskmemload20:41:242
4933996610,28cyclictest545-21kworker/2:223:26:152
29012665,52sleep03097-21cut18:01:190
29012665,52sleep03097-21cut18:01:190
219499660,4rtkit-daemon2193-21rtkit-daemon21:37:442
4933996520,38cyclictest13176-21grep20:26:332
4933996519,29cyclictest2611-21ssh20:11:312
4933996519,29cyclictest2611-21ssh20:11:312
4933996516,41cyclictest0-21swapper/222:07:202
4933996516,41cyclictest0-21swapper/222:07:202
4933996516,32cyclictest0-21swapper/220:51:082
4933996514,44cyclictest0-21swapper/221:02:272
4933996511,35cyclictest0-21swapper/221:41:162
4933996510,48cyclictest0-21swapper/220:16:192
68062643,53sleep10-21swapper/118:06:391
4934996419,27cyclictest29944-21diskmemload22:02:353
4933996418,28cyclictest29944-21diskmemload20:56:162
4933996414,43cyclictest0-21swapper/222:46:072
4933996414,43cyclictest0-21swapper/222:46:072
4933996413,32cyclictest0-21swapper/221:26:342
4933996413,32cyclictest0-21swapper/221:26:342
4933996316,39cyclictest0-21swapper/219:31:232
4933996315,42cyclictest0-21swapper/221:46:312
4933996315,40cyclictest0-21swapper/218:21:212
4933996311,32cyclictest0-21swapper/218:06:172
4933996216,40cyclictest0-21swapper/221:56:162
4933996216,30cyclictest0-21swapper/219:36:182
4933996216,29cyclictest17239-21taskset18:31:172
4933996214,30cyclictest0-21swapper/219:06:222
4933996212,33cyclictest0-21swapper/222:36:252
493499614,12cyclictest0-21swapper/320:46:593
4934996127,28cyclictest7998-21munin-node20:21:333
493399619,44cyclictest0-21swapper/223:24:042
493399617,47cyclictest0-21swapper/218:46:152
493399617,47cyclictest0-21swapper/218:46:152
219499610,6rtkit-daemon0-21swapper/318:27:142
4933996016,36cyclictest1124-21snmpd19:27:072
4933996016,36cyclictest1124-21snmpd19:27:072
4933996016,28cyclictest10510-21ssh22:51:102
4933996010,30cyclictest0-21swapper/219:11:172
493199604,50cyclictest0-21swapper/018:26:360
4931996028,26cyclictest0-21swapper/021:51:410
4931996027,26cyclictest0-21swapper/020:21:280
493399594,37cyclictest0-21swapper/220:01:252
4931995938,14cyclictest0-21swapper/020:16:270
4802596,9sleep00-21swapper/020:10:170
4802596,9sleep00-21swapper/020:10:170
493499586,11cyclictest25934-21aten2.4-expect22:26:053
493499584,35cyclictest0-21swapper/322:46:093
493499584,35cyclictest0-21swapper/322:46:093
493499584,25cyclictest0-21swapper/320:31:333
493399588,30cyclictest0-21swapper/218:16:262
4933995821,12cyclictest28774-21turbostat18:56:032
4933995810,32cyclictest0-21swapper/219:51:152
4932995825,24cyclictest29591-21df_abs22:31:131
4932995822,29cyclictest0-21swapper/121:52:111
4932995810,32cyclictest0-21swapper/120:46:181
219499580,7rtkit-daemon0-21swapper/319:02:582
219499580,6rtkit-daemon2193-21rtkit-daemon18:47:583
219499580,6rtkit-daemon2193-21rtkit-daemon18:47:583
219499580,5rtkit-daemon2193-21rtkit-daemon22:35:043
219499580,5rtkit-daemon2193-21rtkit-daemon21:17:153
219499580,5rtkit-daemon2193-21rtkit-daemon19:01:583
219499580,5rtkit-daemon2193-21rtkit-daemon18:25:443
151422583,11sleep10-21swapper/121:20:571
493499575,33cyclictest0-21swapper/320:41:133
493499574,13cyclictest0-21swapper/323:26:153
4934995725,14cyclictest0-21swapper/322:42:243
4934995719,24cyclictest22713-21cpu22:21:053
493399579,31cyclictest0-21swapper/218:56:232
4933995712,29cyclictest8684-21munin-node19:21:222
493199573,36cyclictest0-21swapper/019:16:230
219499570,6rtkit-daemon2193-21rtkit-daemon21:29:143
219499570,6rtkit-daemon2193-21rtkit-daemon21:29:143
219499570,6rtkit-daemon2193-21rtkit-daemon21:13:383
219499570,6rtkit-daemon2193-21rtkit-daemon20:19:473
219499570,5rtkit-daemon2193-21rtkit-daemon21:52:443
219499570,5rtkit-daemon2193-21rtkit-daemon21:02:313
219499570,5rtkit-daemon2193-21rtkit-daemon19:18:273
219499570,5rtkit-daemon2193-21rtkit-daemon19:12:273
219499570,5rtkit-daemon2193-21rtkit-daemon18:55:203
219499570,5rtkit-daemon2193-21rtkit-daemon18:41:143
219499570,5rtkit-daemon2193-21rtkit-daemon18:41:143
219499570,5rtkit-daemon2193-21rtkit-daemon18:37:143
219499570,5rtkit-daemon2193-21rtkit-daemon18:32:293
219499570,5rtkit-daemon2193-21rtkit-daemon18:26:073
493499564,32cyclictest0-21swapper/320:56:113
493499564,14cyclictest0-21swapper/321:46:423
493399567,41cyclictest0-21swapper/218:11:202
4933995625,25cyclictest26194-21grep19:56:212
493299567,26cyclictest0-21swapper/122:17:111
493299564,45cyclictest0-21swapper/122:47:041
493299564,45cyclictest0-21swapper/122:47:041
4932995627,22cyclictest27488-21gltestperf18:51:231
4932995620,22cyclictest0-21swapper/122:05:101
219499560,5rtkit-daemon2193-21rtkit-daemon22:39:343
219499560,5rtkit-daemon2193-21rtkit-daemon21:35:593
219499560,5rtkit-daemon2193-21rtkit-daemon21:33:523
219499560,5rtkit-daemon2193-21rtkit-daemon21:24:073
219499560,5rtkit-daemon2193-21rtkit-daemon20:52:083
219499560,5rtkit-daemon2193-21rtkit-daemon20:28:393
219499560,5rtkit-daemon2193-21rtkit-daemon20:13:023
219499560,5rtkit-daemon2193-21rtkit-daemon20:13:023
219499560,5rtkit-daemon2193-21rtkit-daemon18:11:153
4933995516,33cyclictest0-21swapper/218:36:282
493299554,44cyclictest0-21swapper/120:44:141
493299554,35cyclictest0-21swapper/119:37:121
4931995533,17cyclictest0-21swapper/023:03:540
493199553,47cyclictest0-21swapper/021:08:120
306092552,10sleep00-21swapper/021:42:170
219499550,5rtkit-daemon2193-21rtkit-daemon22:19:123
219499550,5rtkit-daemon2193-21rtkit-daemon21:57:213
219499550,5rtkit-daemon2193-21rtkit-daemon20:09:553
219499550,5rtkit-daemon2193-21rtkit-daemon20:09:553
73942544,7sleep17469-21cat19:16:241
52812540,9chrt0-21swapper/123:31:231
4934995412,24cyclictest0-21swapper/323:11:143
4933995437,10cyclictest18549-21grep19:41:132
4933995415,20cyclictest0-21swapper/219:47:142
493299547,39cyclictest0-21swapper/120:16:181
493299547,36cyclictest0-21swapper/118:31:041
493299543,34cyclictest2765-21ssh21:01:151
4932995418,21cyclictest0-21swapper/121:56:261
493199545,34cyclictest0-21swapper/021:05:060
493199545,12cyclictest0-21swapper/022:01:280
493199544,44cyclictest0-21swapper/021:21:210
493199544,42cyclictest0-21swapper/020:36:110
493199544,37cyclictest0-21swapper/022:31:240
4931995425,13cyclictest0-21swapper/021:26:310
4931995425,13cyclictest0-21swapper/021:26:310
219499540,6rtkit-daemon0-21swapper/318:41:292
219499540,6rtkit-daemon0-21swapper/318:41:292
177042543,7sleep117709-21rm21:23:111
9892533,7sleep11122-21timerwakeupswit21:46:291
493499534,29cyclictest0-21swapper/323:16:133
493499534,26cyclictest0-21swapper/322:11:133
493299535,40cyclictest0-21swapper/123:26:171
493299535,40cyclictest0-21swapper/120:06:001
493299535,40cyclictest0-21swapper/119:06:331
493299534,39cyclictest0-21swapper/120:36:131
4931995339,9cyclictest0-21swapper/018:57:070
493199533,44cyclictest0-21swapper/022:06:120
493199533,44cyclictest0-21swapper/022:06:120
106462534,9sleep10-21swapper/119:23:381
493499524,30cyclictest0-21swapper/319:21:273
493499524,29cyclictest0-21swapper/319:51:363
4934995233,12cyclictest11931-21gltestperf19:26:223
4934995233,12cyclictest11931-21gltestperf19:26:223
493499523,24cyclictest20531-21taskset23:06:113
4934995221,13cyclictest0-21swapper/321:41:163
493299524,34cyclictest0-21swapper/122:43:331
493299524,33cyclictest0-21swapper/120:57:281
493299524,30cyclictest0-21swapper/122:26:071
493299524,30cyclictest0-21swapper/121:41:101
4932995213,24cyclictest23663-21timerwakeupswit21:31:311
4931995239,9cyclictest0-21swapper/022:42:280
134022523,10sleep10-21swapper/120:26:591
493499517,28cyclictest0-21swapper/322:51:163
493499515,28cyclictest0-21swapper/323:01:073
493499514,29cyclictest0-21swapper/321:10:113
493499514,29cyclictest0-21swapper/320:01:203
493499514,29cyclictest0-21swapper/319:06:223
4934995130,14cyclictest0-21swapper/320:36:283
4934995119,14cyclictest0-21swapper/323:31:183
493299515,28cyclictest0-21swapper/122:56:191
493299515,28cyclictest0-21swapper/118:31:381
493299514,40cyclictest1227-21runrttasks20:31:121
493299514,40cyclictest0-21swapper/121:36:121
493299514,33cyclictest0-21swapper/123:12:261
493299514,29cyclictest0-21swapper/118:21:161
493299513,34cyclictest0-21swapper/120:26:011
4932995121,11cyclictest10195-21munin-node22:51:071
4932995118,26cyclictest29502-21switchtime20:51:301
4932995111,34cyclictest0-21swapper/118:12:391
493199516,31cyclictest0-21swapper/022:28:270
493199513,42cyclictest0-21swapper/019:36:240
260822513,9sleep10-21swapper/118:47:061
260822513,9sleep10-21swapper/118:47:061
224652514,9sleep10-21swapper/123:09:271
183192513,41sleep10-21swapper/119:41:121
106742513,9sleep110761-21gltestperf18:16:261
493499504,28cyclictest0-21swapper/323:20:553
493499504,28cyclictest0-21swapper/322:09:363
493499504,28cyclictest0-21swapper/322:09:363
4934995019,13cyclictest0-21swapper/318:06:263
493299505,28cyclictest0-21swapper/123:17:131
493299505,27cyclictest0-21swapper/121:08:041
493299505,14cyclictest0-21swapper/123:02:241
493299505,14cyclictest0-21swapper/122:22:411
493299505,14cyclictest0-21swapper/121:14:191
493299504,28cyclictest0-21swapper/119:11:351
493299504,28cyclictest0-21swapper/118:41:231
493299504,28cyclictest0-21swapper/118:41:231
4932995019,13cyclictest0-21swapper/122:36:071
493199504,40cyclictest0-21swapper/018:16:400
493199504,38cyclictest0-21swapper/019:21:130
493199503,42cyclictest0-21swapper/021:36:170
4931995029,14cyclictest0-21swapper/018:06:410
4931995024,12cyclictest0-21swapper/022:56:030
309282503,9sleep10-21swapper/118:57:501
274052502,9sleep30-21swapper/319:59:073
155412502,42sleep00-21swapper/019:35:140
99152492,9sleep30-21swapper/318:16:123
493499494,27cyclictest0-21swapper/319:00:183
493399494,27cyclictest0-21swapper/218:06:052
493399494,27cyclictest0-21swapper/218:06:052
493299494,28cyclictest0-21swapper/120:11:361
493299494,28cyclictest0-21swapper/120:11:361
493299494,27cyclictest0-21swapper/122:11:081
493299494,27cyclictest0-21swapper/119:51:351
4932994931,11cyclictest20185-21grep18:36:241
493199494,28cyclictest0-21swapper/018:41:380
493199494,28cyclictest0-21swapper/018:41:380
4931994928,14cyclictest0-21swapper/018:36:260
4931994921,8cyclictest14457-21latency_hist18:26:050
272532492,9sleep00-21swapper/019:57:070
156682493,40sleep10-21swapper/122:10:451
156682493,40sleep10-21swapper/122:10:451
493299486,25cyclictest0-21swapper/121:29:091
493299486,25cyclictest0-21swapper/121:29:091
493299483,24cyclictest0-21swapper/120:08:391
493299483,24cyclictest0-21swapper/120:08:391
493199484,39cyclictest0-21swapper/019:41:290
493199484,27cyclictest0-21swapper/018:11:220
4931994827,14cyclictest0-21swapper/018:31:240
229892484,9sleep00-21swapper/019:51:020
225162482,9sleep30-21swapper/319:47:473
493499474,26cyclictest0-21swapper/319:42:163
493199473,21cyclictest0-21swapper/019:11:130
177982472,9sleep30-21swapper/319:38:323
8042463,9sleep10-21swapper/119:02:101
493299464,33cyclictest0-21swapper/119:56:131
4932994618,21cyclictest13762-21cpuspeed_turbos19:31:151
493199464,26cyclictest0-21swapper/018:51:250
493199464,25cyclictest0-21swapper/019:02:070
493199464,24cyclictest0-21swapper/020:01:140
493199463,38cyclictest0-21swapper/019:26:340
493199463,38cyclictest0-21swapper/019:26:340
131842453,36sleep10-21swapper/119:30:351
131842453,36sleep10-21swapper/119:30:351
493499445,22cyclictest13995-21df_abs19:31:173
46692444,34sleep30-21swapper/318:03:113
46692444,34sleep30-21swapper/318:03:113
224332443,34sleep10-21swapper/119:46:441
493299394,12cyclictest0-21swapper/118:06:051
493299394,12cyclictest0-21swapper/118:06:051
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional