You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-26 - 09:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Tue May 26, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1985621640,11sleep1182099cyclictest19:11:411
49552970,11sleep1182099cyclictest22:01:241
264112663,56sleep00-21swapper/020:11:150
248599660,4rtkit-daemon2484-21rtkit-daemon19:57:133
297232643,9sleep329851-21unixbench_multi19:26:353
248599630,20rtkit-daemon2484-21rtkit-daemon20:19:583
1816996322,35cyclictest813-21cstates20:21:130
181699614,15cyclictest0-21swapper/019:11:140
121472614,49sleep112159-21munin-node19:01:261
45372603,8sleep31287-21snmpd19:36:593
286902604,48sleep00-21swapper/018:39:520
127932600,4sleep312907-21cpuspeed19:51:143
1821995934,8cyclictest28672-21ssh21:50:192
1816995933,11cyclictest0-21swapper/021:11:260
248599580,21rtkit-daemon2484-21rtkit-daemon21:53:313
182299583,46cyclictest4284-21ssh18:51:173
41242573,48sleep20-21swapper/221:12:042
303842575,7sleep10-21swapper/118:41:261
303842575,7sleep10-21swapper/118:41:261
248599570,5rtkit-daemon2484-21rtkit-daemon19:22:303
1822995740,10cyclictest14701-21gltestperf18:11:243
1821995714,28cyclictest0-21swapper/221:27:202
1820995732,9cyclictest32730-21sort21:56:081
1820995729,12cyclictest0-21swapper/118:59:121
1816995726,13cyclictest0-21swapper/020:26:320
179982573,9sleep00-21swapper/019:56:560
270102567,9sleep00-21swapper/017:26:410
270102567,9sleep00-21swapper/017:26:410
248599560,5rtkit-daemon2484-21rtkit-daemon17:41:342
182199563,37cyclictest0-21swapper/221:55:192
181699563,13cyclictest0-21swapper/020:08:370
181699563,13cyclictest0-21swapper/020:08:370
178552565,9sleep00-21swapper/021:32:460
296392554,9sleep00-21swapper/017:32:450
248599550,6rtkit-daemon2484-21rtkit-daemon16:41:292
248599550,6rtkit-daemon2484-21rtkit-daemon16:41:292
248599550,5rtkit-daemon2484-21rtkit-daemon18:01:182
248599550,5rtkit-daemon2484-21rtkit-daemon18:01:182
248599550,5rtkit-daemon2484-21rtkit-daemon17:22:422
248599550,5rtkit-daemon2484-21rtkit-daemon17:22:422
248599550,5rtkit-daemon2484-21rtkit-daemon17:11:352
248599550,4rtkit-daemon2484-21rtkit-daemon21:31:023
182299556,35cyclictest0-21swapper/320:31:183
1822995515,24cyclictest0-21swapper/321:17:293
182199554,45cyclictest0-21swapper/220:22:282
1821995510,29cyclictest0-21swapper/220:56:282
1820995535,10cyclictest0-21swapper/118:48:301
1820995535,10cyclictest0-21swapper/118:48:301
1820995531,11cyclictest0-21swapper/119:44:291
1820995525,8cyclictest3061-21hwlatdetect21:11:181
1820995518,31cyclictest29804-21fschecks_count21:51:151
181699555,43cyclictest0-21swapper/019:01:330
181699553,46cyclictest0-21swapper/019:22:270
161392553,45sleep30-21swapper/320:42:013
107462554,44sleep20-21swapper/216:54:062
316982542,9sleep20-21swapper/218:43:092
316982542,9sleep20-21swapper/218:43:092
310482543,9sleep00-21swapper/019:30:350
249132543,9sleep00-21swapper/017:23:340
249132543,9sleep00-21swapper/017:23:340
248599540,5rtkit-daemon2484-21rtkit-daemon18:06:182
248599540,5rtkit-daemon2484-21rtkit-daemon16:46:282
221232543,45sleep20-21swapper/220:04:402
182299544,43cyclictest0-21swapper/321:56:093
182199546,31cyclictest0-21swapper/219:51:342
182199545,31cyclictest0-21swapper/219:21:542
182199544,36cyclictest0-21swapper/219:30:462
1821995437,11cyclictest17884-21cpuspeed_turbos20:46:122
1821995437,11cyclictest17884-21cpuspeed_turbos20:46:122
182199543,45cyclictest0-21swapper/220:11:172
182099542,46cyclictest0-21swapper/119:30:171
181699543,46cyclictest0-21swapper/021:23:540
1816995421,23cyclictest0-21swapper/020:01:260
1816995419,13cyclictest0-21swapper/017:11:210
148152546,10sleep00-21swapper/021:28:590
133352542,45sleep00-21swapper/018:07:360
248599530,5rtkit-daemon2484-21rtkit-daemon17:06:282
248599530,5rtkit-daemon2484-21rtkit-daemon17:01:202
242952533,10sleep20-21swapper/219:20:342
1822995337,9cyclictest21709-21tr20:51:183
182199538,30cyclictest0-21swapper/219:11:592
182199535,29cyclictest0-21swapper/219:36:342
1820995327,12cyclictest0-21swapper/121:36:151
181699533,44cyclictest0-21swapper/019:45:230
1816995329,12cyclictest0-21swapper/018:58:170
1816995328,12cyclictest0-21swapper/020:46:100
1816995328,12cyclictest0-21swapper/020:46:100
1816995328,12cyclictest0-21swapper/019:06:220
1816995323,14cyclictest0-21swapper/018:47:240
1816995323,14cyclictest0-21swapper/018:47:240
144732532,9sleep00-21swapper/019:51:360
295372523,42sleep10-21swapper/121:01:391
271992524,41sleep10-21swapper/120:11:241
262362522,9sleep30-21swapper/317:26:283
262362522,9sleep30-21swapper/317:26:283
250572523,43sleep20-21swapper/220:08:062
250572523,43sleep20-21swapper/220:08:062
248599520,5rtkit-daemon2484-21rtkit-daemon20:06:213
248599520,5rtkit-daemon2484-21rtkit-daemon20:06:213
248599520,5rtkit-daemon2484-21rtkit-daemon20:01:213
248599520,5rtkit-daemon2484-21rtkit-daemon19:49:593
248599520,5rtkit-daemon2484-21rtkit-daemon17:56:332
248599520,5rtkit-daemon2484-21rtkit-daemon17:51:332
248599520,5rtkit-daemon2484-21rtkit-daemon17:16:352
199382523,9sleep30-21swapper/319:12:003
1822995237,9cyclictest15290-21grep19:06:203
1822995235,12cyclictest0-21swapper/320:40:513
182199527,29cyclictest0-21swapper/219:41:242
182199525,40cyclictest0-21swapper/218:56:132
182199525,31cyclictest0-21swapper/218:48:182
182199525,31cyclictest0-21swapper/218:48:182
182199525,27cyclictest0-21swapper/220:31:102
182199525,12cyclictest0-21swapper/221:06:152
182199524,40cyclictest0-21swapper/221:57:582
182199524,39cyclictest0-21swapper/219:50:222
182199523,38cyclictest3953-21taskset20:26:022
182199523,38cyclictest0-21swapper/220:54:542
1821995224,13cyclictest0-21swapper/220:20:092
182199522,45cyclictest0-21swapper/221:24:342
182099522,45cyclictest0-21swapper/121:26:111
181699528,37cyclictest0-21swapper/020:36:090
181699523,44cyclictest0-21swapper/021:36:110
181699523,43cyclictest0-21swapper/021:03:010
1816995225,12cyclictest0-21swapper/021:41:280
1816995224,12cyclictest0-21swapper/019:31:230
1816995224,12cyclictest0-21swapper/018:55:500
1816995222,13cyclictest0-21swapper/021:18:180
181699522,45cyclictest0-21swapper/020:32:210
139702523,7sleep314092-21sed21:26:323
129812527,9sleep00-21swapper/016:57:060
121892522,10sleep10-21swapper/119:50:201
108932526,9sleep00-21swapper/016:56:020
320812513,41sleep00-21swapper/020:19:050
285742515,9sleep00-21swapper/021:49:590
248599510,5rtkit-daemon2484-21rtkit-daemon21:08:263
248599510,5rtkit-daemon2484-21rtkit-daemon20:56:263
248599510,5rtkit-daemon2484-21rtkit-daemon19:43:223
248599510,4rtkit-daemon2484-21rtkit-daemon21:49:093
182299514,31cyclictest0-21swapper/321:22:313
182299512,38cyclictest27621-21ssh20:11:303
182199514,42cyclictest0-21swapper/221:44:392
182199514,39cyclictest0-21swapper/219:08:382
182199514,33cyclictest0-21swapper/218:37:472
1821995134,10cyclictest16391-21grep19:56:142
182199513,41cyclictest0-21swapper/221:38:262
182199513,41cyclictest0-21swapper/221:17:032
1821995122,14cyclictest0-21swapper/216:36:372
1821995122,13cyclictest0-21swapper/219:05:542
1821995121,14cyclictest0-21swapper/219:31:192
182199512,44cyclictest0-21swapper/218:53:482
1821995117,14cyclictest0-21swapper/222:01:312
182099513,42cyclictest0-21swapper/119:31:191
182099513,30cyclictest0-21swapper/120:53:371
1820995123,11cyclictest22767-21munin-node20:06:141
1820995123,11cyclictest22767-21munin-node20:06:141
1820995117,12cyclictest0-21swapper/118:36:081
181699513,41cyclictest30887-21ssh18:41:350
181699513,41cyclictest30887-21ssh18:41:350
181699513,14cyclictest0-21swapper/022:04:360
1816995127,11cyclictest0-21swapper/020:51:320
1816995125,9cyclictest15185-21iostat_ios20:41:220
1816995123,12cyclictest0-21swapper/019:37:220
1816995123,12cyclictest0-21swapper/018:31:380
1816995123,11cyclictest0-21swapper/017:01:350
1816995122,13cyclictest0-21swapper/017:41:320
1816995121,11cyclictest0-21swapper/018:21:210
1816995117,10cyclictest0-21swapper/019:49:090
132262513,9sleep20-21swapper/217:00:192
294892503,38sleep10-21swapper/120:16:071
248599500,5rtkit-daemon2484-21rtkit-daemon21:37:553
248599500,5rtkit-daemon2484-21rtkit-daemon20:21:053
248599500,4rtkit-daemon2484-21rtkit-daemon20:26:053
23952502,10sleep30-21swapper/316:36:223
182199505,38cyclictest14748-21sort20:41:162
182199505,38cyclictest0-21swapper/218:36:032
182199504,37cyclictest0-21swapper/221:31:272
182199504,29cyclictest0-21swapper/220:36:092
182099504,40cyclictest16052-21ssh20:41:421
182099504,39cyclictest18422-21ssh19:58:281
182099503,41cyclictest25567-21diskmemload20:40:521
182099503,41cyclictest0-21swapper/118:52:121
1820995025,12cyclictest0-21swapper/120:56:261
1820995025,11cyclictest0-21swapper/120:31:131
1820995023,10cyclictest1112-21fschecks_count20:21:161
1820995016,28cyclictest22492-21crond20:06:001
1820995013,31cyclictest0-21swapper/120:46:261
1820995013,31cyclictest0-21swapper/120:46:261
1816995022,9cyclictest29120-21munin-node21:51:200
1816995022,12cyclictest0-21swapper/021:59:470
1816995022,12cyclictest0-21swapper/021:09:330
1816995021,12cyclictest0-21swapper/019:16:200
181699502,44cyclictest0-21swapper/020:56:280
152272502,9sleep30-21swapper/317:01:493
131252502,9sleep30-21swapper/316:58:593
87052492,9sleep30-21swapper/316:48:593
47822494,39sleep10-21swapper/119:37:541
248599490,5rtkit-daemon2484-21rtkit-daemon21:42:173
248599490,5rtkit-daemon2484-21rtkit-daemon17:31:272
248599490,4rtkit-daemon2484-21rtkit-daemon19:19:073
244562493,39sleep124581-21cat17:21:381
244562493,39sleep124581-21cat17:21:381
200052492,40sleep30-21swapper/317:11:493
182299494,27cyclictest0-21swapper/321:11:213
182299493,40cyclictest0-21swapper/322:03:573
182299493,40cyclictest0-21swapper/318:46:153
182299493,40cyclictest0-21swapper/318:46:153
182299493,37cyclictest0-21swapper/320:48:483
182299493,37cyclictest0-21swapper/320:48:483
1822994922,11cyclictest0-21swapper/319:31:343
182199497,27cyclictest0-21swapper/217:37:142
182199495,25cyclictest0-21swapper/221:01:162
1821994921,12cyclictest0-21swapper/217:26:222
1821994921,12cyclictest0-21swapper/217:26:222
182099494,26cyclictest0-21swapper/119:51:141
182099493,40cyclictest20609-21kworker/1:219:18:461
1820994921,8cyclictest24735-21rm19:21:141
182099492,42cyclictest0-21swapper/121:22:241
181699497,35cyclictest0-21swapper/016:37:370
1816994924,8cyclictest9382-21tr18:01:190
1816994924,8cyclictest9382-21tr18:01:190
1816994922,11cyclictest0-21swapper/016:46:130
248599480,5rtkit-daemon2484-21rtkit-daemon19:01:233
248599480,5rtkit-daemon2484-21rtkit-daemon18:58:083
1822994832,9cyclictest5752-21head16:41:343
1822994832,9cyclictest5752-21head16:41:343
182299483,38cyclictest26586-21grep18:36:213
182299483,28cyclictest0-21swapper/317:21:193
182299483,28cyclictest0-21swapper/317:21:193
182299483,11cyclictest0-21swapper/318:41:163
182299483,11cyclictest0-21swapper/318:41:163
182199484,27cyclictest0-21swapper/218:11:372
182199484,12cyclictest0-21swapper/218:21:162
182099486,35cyclictest0-21swapper/121:31:281
182099483,40cyclictest0-21swapper/121:46:151
1820994826,11cyclictest0-21swapper/120:26:101
1820994819,13cyclictest0-21swapper/121:41:011
1820994817,14cyclictest0-21swapper/119:10:281
181699483,38cyclictest0-21swapper/018:11:190
1816994827,15cyclictest0-21swapper/017:16:310
1816994821,12cyclictest0-21swapper/017:06:370
138342488,9sleep10-21swapper/118:11:111
43302473,9sleep30-21swapper/317:49:533
42402472,39sleep00-21swapper/017:48:420
231242472,9sleep30-21swapper/318:30:283
182299475,37cyclictest20483-21yum-updatesd-he18:22:343
182299474,36cyclictest0-21swapper/317:21:073
1822994731,9cyclictest28003-21cpuspeed_turbos21:01:113
1822994730,10cyclictest31826-21unixbench_multi17:36:393
182299473,38cyclictest32547-21telnet17:41:183
1822994714,15cyclictest0-21swapper/317:11:073
182199474,28cyclictest0-21swapper/218:26:312
182199473,38cyclictest281ktimersoftd/217:46:352
1820994719,12cyclictest0-21swapper/116:56:231
1816994722,9cyclictest0-21swapper/016:41:240
1816994722,9cyclictest0-21swapper/016:41:240
1816994722,8cyclictest21010-21munin-node18:26:360
66002464,9sleep10-21swapper/116:44:581
66002464,9sleep10-21swapper/116:44:581
61662463,9sleep00-21swapper/017:52:320
254892465,9sleep10-21swapper/118:35:141
182299463,26cyclictest0-21swapper/318:01:333
182299463,26cyclictest0-21swapper/318:01:333
1820994631,9cyclictest3142-21gltestperf17:46:251
1820994622,9cyclictest30995-21munin-node21:06:181
1820994621,9cyclictest29025-21munin-node17:31:331
1820994619,11cyclictest0-21swapper/117:51:191
1816994626,15cyclictest0-21swapper/017:36:320
1816994618,12cyclictest0-21swapper/018:16:330
17452464,6sleep00-21swapper/016:35:380
87592453,36sleep00-21swapper/018:00:100
320032452,37sleep10-21swapper/117:37:301
254292452,36sleep30-21swapper/318:34:273
182299454,31cyclictest4663-21munin-node17:51:213
182299453,36cyclictest28774-21iostat_ios17:31:293
182299453,33cyclictest16238-21munin-node18:16:283
182299453,27cyclictest0-21swapper/318:07:193
182099454,36cyclictest0-21swapper/118:01:081
182099454,36cyclictest0-21swapper/118:01:081
1820994526,14cyclictest0-21swapper/118:26:321
1820994522,8cyclictest201ktimersoftd/121:16:141
1820994520,9cyclictest16602-21taskset17:06:241
1820994520,8cyclictest18189-21munin-node17:11:321
180642452,9sleep10-21swapper/118:16:561
37522444,34sleep13886-21sed16:36:401
182299443,35cyclictest0-21swapper/318:01:053
1821994428,10cyclictest16984-21fschecks_time18:16:242
1820994421,8cyclictest6931-21munin-node16:46:251
182099442,26cyclictest0-21swapper/118:21:231
1820994419,8cyclictest7433-21perl17:56:231
1820994417,11cyclictest0-21swapper/116:51:251
4552434,33sleep10-21swapper/116:31:251
182299433,33cyclictest0-21swapper/316:51:203
182099434,34cyclictest0-21swapper/118:06:381
182099434,34cyclictest0-21swapper/117:01:231
182099433,34cyclictest0-21swapper/117:42:251
182099432,37cyclictest0-21swapper/117:27:261
182099432,37cyclictest0-21swapper/117:27:261
1820994317,11cyclictest0-21swapper/117:16:281
15402414,30sleep20-21swapper/216:33:072
182299372,20cyclictest0-21swapper/316:36:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional