You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-08 - 10:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Wed Apr 08, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991090,4rtkit-daemon0-21swapper/220:26:342
115079910119,10cyclictest13980-21switchtime21:56:353
115059910030,12cyclictest31736-21unixbench_singl20:46:391
115059910030,12cyclictest31736-21unixbench_singl20:46:391
1150599994,15cyclictest0-21swapper/120:04:441
11507999735,42cyclictest29308-21runrttasks20:44:513
248599960,5rtkit-daemon0-21swapper/220:36:341
1150599954,13cyclictest0-21swapper/120:30:571
248599940,7rtkit-daemon0-21swapper/120:21:191
1150799944,28cyclictest0-21swapper/320:15:553
1150799944,28cyclictest0-21swapper/320:15:553
11503999411,12cyclictest0-21swapper/021:31:270
248599930,7rtkit-daemon0-21swapper/120:36:413
1150599934,13cyclictest3121-21sh20:06:181
1150599934,13cyclictest3121-21sh20:06:181
11503999320,51cyclictest0-21swapper/022:25:580
1150799924,27cyclictest0-21swapper/321:01:203
11503999243,42cyclictest0-21swapper/021:41:360
11503999110,11cyclictest0-21swapper/020:10:070
11503999110,11cyclictest0-21swapper/020:10:070
1150799904,78cyclictest0-21swapper/320:56:073
1150799904,24cyclictest0-21swapper/319:49:123
1150599905,15cyclictest0-21swapper/122:11:161
1150599905,15cyclictest0-21swapper/122:11:161
1150399904,79cyclictest259121munin-node22:16:240
1150799895,25cyclictest0-21swapper/322:30:503
11503998925,48cyclictest372-21sed20:01:250
11503998920,61cyclictest0-21swapper/022:46:200
11503998916,55cyclictest0-21swapper/021:26:370
11503998911,12cyclictest0-21swapper/020:36:400
162012880,10sleep01150399cyclictest19:36:360
11507998826,54cyclictest308-21gltestperf19:11:283
1150399884,22cyclictest0-21swapper/022:33:480
11503998810,56cyclictest0-21swapper/020:11:290
11503998810,56cyclictest0-21swapper/020:11:290
11507998721,12cyclictest0-21swapper/321:16:173
1150399874,76cyclictest0-21swapper/019:51:390
11503998738,42cyclictest0-21swapper/019:41:390
1150399873,76cyclictest21325-21taskset20:31:350
1150399873,76cyclictest0-21swapper/019:46:200
11503998716,10cyclictest0-21swapper/020:28:110
11503998710,13cyclictest0-21swapper/022:40:230
1150799864,22cyclictest0-21swapper/321:32:313
1150799864,22cyclictest0-21swapper/320:56:163
1150799863,25cyclictest0-21swapper/321:12:363
1150799863,22cyclictest8507-21taskset21:50:043
11507998623,54cyclictest26206-21sh17:51:253
11507998611,15cyclictest0-21swapper/319:31:363
1150399863,76cyclictest13124-21unixbench_multi19:31:420
1150399863,22cyclictest0-21swapper/022:41:410
311852850,6sleep20-21swapper/219:06:432
1150799855,24cyclictest0-21swapper/321:36:273
1150799853,27cyclictest0-21swapper/322:13:193
1150799853,27cyclictest0-21swapper/322:13:193
11507998524,54cyclictest0-21swapper/319:58:273
1150399854,64cyclictest306-21python21:36:360
1150399853,75cyclictest0-21swapper/021:46:160
1150399853,74cyclictest11359-21grep18:26:310
1150399853,22cyclictest0-21swapper/019:30:500
1150399853,22cyclictest0-21swapper/019:30:500
11503998523,56cyclictest1419-21runrttasks18:35:470
11503998522,44cyclictest30587-21latency_hist18:01:130
1150799845,71cyclictest0-21swapper/320:46:203
1150799845,71cyclictest0-21swapper/320:46:203
1150799845,13cyclictest0-21swapper/322:21:143
1150799844,72cyclictest0-21swapper/322:08:473
1150799844,13cyclictest0-21swapper/319:23:013
1150799843,26cyclictest0-21swapper/319:52:233
1150399844,71cyclictest0-21swapper/020:51:210
1150399843,75cyclictest0-21swapper/022:01:280
1150399843,74cyclictest0-21swapper/020:20:030
1150399843,73cyclictest0-21swapper/021:11:310
1150399843,72cyclictest0-21swapper/020:25:130
11503998419,8cyclictest9796-21ssh21:51:220
1150799838,20cyclictest0-21swapper/320:08:103
1150799838,20cyclictest0-21swapper/320:08:103
1150799833,12cyclictest0-21swapper/322:50:083
11507998328,47cyclictest16381-21latency_hist20:26:083
11507998321,9cyclictest16657-21aten_r1power_vo20:26:173
11507998314,55cyclictest0-21swapper/322:38:253
1150399834,13cyclictest0-21swapper/020:59:210
1150399833,73cyclictest1419-21runrttasks19:10:500
106432830,14sleep11150599cyclictest21:51:351
54832820,3sleep226-21rcuc/220:56:292
1150799829,8cyclictest121850irq/46-eth022:36:013
1150799825,23cyclictest0-21swapper/321:43:193
1150799824,71cyclictest0-21swapper/321:55:173
1150799824,70cyclictest0-21swapper/322:02:013
1150799824,70cyclictest0-21swapper/318:56:383
1150799824,25cyclictest0-21swapper/321:28:293
1150799823,61cyclictest0-21swapper/321:06:213
11507998210,13cyclictest0-21swapper/322:16:483
1150399824,71cyclictest0-21swapper/022:06:340
11503998238,38cyclictest0-21swapper/020:41:360
1150399823,70cyclictest0-21swapper/021:16:230
1150799815,22cyclictest0-21swapper/320:19:073
1150799815,20cyclictest0-21swapper/319:40:323
1150799815,11cyclictest0-21swapper/318:31:353
1150799814,22cyclictest0-21swapper/322:45:243
1150799814,22cyclictest0-21swapper/317:21:263
1150799814,22cyclictest0-21swapper/317:21:263
1150799814,21cyclictest0-21swapper/319:43:243
1150799814,13cyclictest0-21swapper/320:33:333
1150399814,69cyclictest0-21swapper/021:56:260
1150399814,14cyclictest0-21swapper/017:21:140
1150399814,12cyclictest0-21swapper/017:21:260
1150399814,12cyclictest0-21swapper/017:21:260
1150399813,72cyclictest0-21swapper/022:26:200
1150399813,72cyclictest0-21swapper/021:21:510
1150399813,71cyclictest0-21swapper/021:01:230
11503998122,8cyclictest20037-21munin-node18:46:440
11503998122,8cyclictest20037-21munin-node18:46:440
11503998119,55cyclictest0-21swapper/017:31:270
1150799805,23cyclictest0-21swapper/318:16:233
1150799803,16cyclictest0-21swapper/319:26:203
1150799803,16cyclictest0-21swapper/319:26:203
11507998029,44cyclictest15387-21aten_r1power_po18:36:243
11507998021,10cyclictest19044-21aten_r1power_vo17:36:273
1150399804,70cyclictest0-21swapper/021:06:370
1150399804,7cyclictest24576-21latency_hist18:56:110
1150399804,69cyclictest0-21swapper/020:49:440
1150399804,69cyclictest0-21swapper/020:49:440
11503998023,50cyclictest0-21swapper/019:56:240
1150799796,18cyclictest0-21swapper/318:31:123
1150799794,23cyclictest0-21swapper/318:06:373
1150799794,12cyclictest0-21swapper/321:21:383
11507997921,10cyclictest1276-21unixbench_multi20:01:383
1150399794,68cyclictest0-21swapper/022:11:150
1150399794,68cyclictest0-21swapper/022:11:150
11503997925,48cyclictest0-21swapper/019:23:240
11503997923,49cyclictest0-21swapper/018:11:300
12372780,5chrt1236-21expr20:51:201
1150799784,28cyclictest0-21swapper/318:04:423
1150399784,67cyclictest0-21swapper/017:41:250
1150399784,66cyclictest0-21swapper/018:36:250
11503997815,10cyclictest0-21swapper/018:07:500
1150799774,12cyclictest0-21swapper/317:26:253
1150799774,11cyclictest4119-21grep18:11:323
1150399773,67cyclictest0-21swapper/019:16:230
1150799764,32cyclictest0-21swapper/319:01:233
1150799764,14cyclictest0-21swapper/318:41:403
11507997612,13cyclictest0-21swapper/317:46:243
1150399764,65cyclictest20154-21ntpdc17:36:410
11503997632,38cyclictest25578-21tune2fs18:56:280
11503997622,48cyclictest0-21swapper/017:51:240
1150799758,14cyclictest0-21swapper/317:56:543
1150799755,30cyclictest0-21swapper/317:31:273
1150799754,21cyclictest0-21swapper/319:16:213
1150399754,23cyclictest0-21swapper/019:01:370
296622740,3sleep20-21swapper/222:21:152
1150799744,14cyclictest0-21swapper/319:07:593
11507997424,8cyclictest9129-21kernelversion18:21:343
1150399743,63cyclictest0-21swapper/017:51:120
1150799734,12cyclictest0-21swapper/318:47:183
1150799734,12cyclictest0-21swapper/318:47:183
1150399734,62cyclictest0-21swapper/018:01:410
1150399733,63cyclictest0-21swapper/017:26:470
11503997323,44cyclictest32557-21forks19:11:260
1150399724,13cyclictest0-21swapper/018:16:250
1150399723,63cyclictest8124-21seq18:21:220
1150399713,19cyclictest0-21swapper/018:41:220
1150799705,12cyclictest0-21swapper/318:51:223
11507996825,8cyclictest22263-21if_eth017:41:353
182472664,12sleep20-21swapper/218:41:292
11506996632,26cyclictest12771-21cpuspeed_turbos21:56:172
301142636,10sleep10-21swapper/121:32:531
11506996312,41cyclictest0-21swapper/221:31:232
11506996120,23cyclictest8926-21ssh19:26:302
11506996120,23cyclictest8926-21ssh19:26:302
11505996124,30cyclictest0-21swapper/122:18:411
111672614,13sleep20-21swapper/221:06:182
37402600,6sleep23741-21cut22:31:112
248599600,4rtkit-daemon2484-21rtkit-daemon18:56:301
1150599605,15cyclictest0-21swapper/119:25:421
37732596,7sleep10-21swapper/121:41:321
233212598,8sleep123355-21python19:46:381
1150699594,36cyclictest0-21swapper/220:51:312
11506995917,28cyclictest0-21swapper/220:05:022
1150599594,34cyclictest0-21swapper/122:01:471
1150599594,13cyclictest0-21swapper/122:21:131
1150699585,31cyclictest1419-21runrttasks20:41:222
1150599585,13cyclictest0-21swapper/119:51:361
1150599584,14cyclictest0-21swapper/119:34:271
1150599584,13cyclictest0-21swapper/122:28:221
1150599584,13cyclictest0-21swapper/121:16:271
1150599584,13cyclictest0-21swapper/121:03:481
1150599583,20cyclictest10101-21taskset19:27:541
1150599583,20cyclictest10101-21taskset19:27:541
11505995814,27cyclictest0-21swapper/119:38:021
273602573,11sleep20-21swapper/221:30:082
269732573,47sleep10-21swapper/121:28:421
1150699574,24cyclictest21902-21fschecks_time21:21:232
1150599575,32cyclictest0-21swapper/121:58:391
1150599575,32cyclictest0-21swapper/119:41:311
242682563,46sleep10-21swapper/118:52:161
174272563,46sleep10-21swapper/121:15:401
1150699564,37cyclictest0-21swapper/222:42:462
1150699564,36cyclictest0-21swapper/219:25:032
11506995614,25cyclictest12234-21gltestperf19:31:282
11506995611,27cyclictest0-21swapper/221:01:272
11506995611,26cyclictest0-21swapper/220:11:302
11506995611,26cyclictest0-21swapper/220:11:302
1150599565,29cyclictest0-21swapper/121:06:261
1150599564,36cyclictest0-21swapper/120:20:251
1150599564,13cyclictest0-21swapper/120:43:351
11505995611,26cyclictest0-21swapper/120:31:301
178662553,12sleep20-21swapper/221:16:172
1150699555,42cyclictest0-21swapper/220:06:172
1150699555,42cyclictest0-21swapper/220:06:172
1150699554,35cyclictest0-21swapper/222:48:532
1150699554,31cyclictest0-21swapper/221:36:222
11506995539,10cyclictest15342-21nscd21:56:022
1150699553,43cyclictest0-21swapper/222:06:032
11506995522,27cyclictest0-21swapper/219:58:302
11506995522,14cyclictest0-21swapper/222:36:152
11506995513,33cyclictest0-21swapper/222:16:072
1150599555,28cyclictest0-21swapper/121:00:101
1150599554,28cyclictest0-21swapper/121:38:251
1150599554,21cyclictest22917-21ssh21:21:381
242842543,10sleep20-21swapper/218:52:292
160472543,10sleep10-21swapper/117:28:281
1150699545,14cyclictest0-21swapper/220:46:162
1150699545,14cyclictest0-21swapper/220:46:162
1150699544,43cyclictest0-21swapper/219:41:312
1150699544,42cyclictest0-21swapper/220:21:192
1150699544,30cyclictest0-21swapper/220:16:182
1150699544,29cyclictest0-21swapper/219:16:272
1150699543,13cyclictest4245-21diskmemload22:26:202
11506995422,13cyclictest0-21swapper/219:40:262
11506995421,14cyclictest0-21swapper/218:16:332
1150599544,31cyclictest0-21swapper/122:11:021
11505995437,11cyclictest0-21swapper/119:56:421
11505995420,15cyclictest0-21swapper/121:46:291
11505995419,13cyclictest0-21swapper/122:38:131
149282533,10sleep20-21swapper/218:35:002
1150699535,14cyclictest0-21swapper/219:51:172
1150699534,42cyclictest0-21swapper/222:11:282
1150699534,42cyclictest0-21swapper/222:11:282
1150699534,32cyclictest0-21swapper/218:06:252
11506995331,15cyclictest0-21swapper/219:46:422
11506995321,26cyclictest0-21swapper/220:36:302
11506995321,14cyclictest0-21swapper/217:51:442
11506995320,12cyclictest1287-21snmpd18:36:452
1150599534,29cyclictest0-21swapper/122:35:411
11505995321,13cyclictest0-21swapper/122:41:341
56992522,11sleep10-21swapper/118:16:161
1150699524,29cyclictest0-21swapper/221:46:202
1150699524,29cyclictest0-21swapper/221:41:142
1150699524,29cyclictest0-21swapper/221:11:202
1150699524,26cyclictest0-21swapper/219:11:212
1150699524,15cyclictest0-21swapper/222:07:372
11506995221,13cyclictest0-21swapper/217:56:382
11506995220,13cyclictest0-21swapper/217:46:122
11506995214,20cyclictest0-21swapper/217:36:252
1150599525,27cyclictest0-21swapper/117:51:461
1150599524,39cyclictest22123-21gltestperf17:41:331
1150599524,29cyclictest0-21swapper/119:06:341
11505995215,14cyclictest0-21swapper/119:02:581
1150699515,28cyclictest0-21swapper/217:26:282
1150699514,28cyclictest0-21swapper/218:56:312
1150699514,28cyclictest0-21swapper/217:31:292
1150699514,27cyclictest0-21swapper/219:01:262
11506995134,11cyclictest24343-21fschecks_time17:46:302
1150599514,38cyclictest0-21swapper/117:56:451
1150599514,27cyclictest14658-21head22:46:231
1150599514,26cyclictest0-21swapper/120:13:401
1150599514,26cyclictest0-21swapper/120:13:401
1150599514,25cyclictest0-21swapper/119:16:371
1150599514,25cyclictest0-21swapper/119:13:001
11505995120,13cyclictest0-21swapper/118:36:321
11505995117,12cyclictest0-21swapper/117:46:551
11505995115,12cyclictest0-21swapper/117:26:151
11505995115,12cyclictest0-21swapper/117:26:151
326902503,10sleep20-21swapper/218:02:392
1150699505,35cyclictest0-21swapper/218:51:112
1150699505,35cyclictest0-21swapper/218:51:112
1150699504,28cyclictest0-21swapper/220:31:292
1150699504,28cyclictest0-21swapper/218:21:402
1150599503,29cyclictest0-21swapper/117:39:171
11505995025,18cyclictest0-21swapper/118:16:121
11505995020,12cyclictest0-21swapper/118:46:301
11505995020,12cyclictest0-21swapper/118:46:301
1150699494,26cyclictest0-21swapper/217:22:422
1150699494,26cyclictest0-21swapper/217:22:422
1150599494,22cyclictest0-21swapper/118:01:281
128662484,10sleep10-21swapper/118:31:161
11506994822,19cyclictest11547-21wc18:26:352
1150599483,22cyclictest2889-21sshd18:08:541
11506994717,13cyclictest0-21swapper/218:12:502
1150599474,22cyclictest0-21swapper/118:26:231
1150599473,23cyclictest0-21swapper/118:41:231
11505994525,13cyclictest0-21swapper/117:36:141
1150599424,14cyclictest0-21swapper/118:21:231
1150599383,29cyclictest11494-21cyclictest17:21:141
112142383,29sleep30-21swapper/317:17:553
1150699366,21cyclictest0-21swapper/217:21:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional