You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 15:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Wed Jan 07, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28466999231,9cyclictest1287-21snmpd11:48:000
28466999123,61cyclictest0-21swapper/008:26:380
28466998421,12cyclictest0-21swapper/007:41:100
28466998015,10cyclictest0-21swapper/010:04:370
28466998015,10cyclictest0-21swapper/010:04:370
28466997919,21cyclictest0-21swapper/009:31:290
28471996534,8cyclictest5144-21grep11:31:352
2847199633,52cyclictest0-21swapper/207:36:102
19032634,52sleep30-21swapper/310:21:043
28472996118,24cyclictest25376-21timerwakeupswit11:06:343
2847199613,50cyclictest0-21swapper/211:06:182
248599610,4rtkit-daemon2484-21rtkit-daemon11:54:523
2847199603,50cyclictest0-21swapper/211:56:002
28471995918,23cyclictest0-21swapper/211:21:322
28472995837,11cyclictest24647-21crond12:15:593
2847199583,47cyclictest4974-21sendmail_mailqu07:01:412
194222580,4sleep119421-21unixbench_multi12:01:331
2847199573,48cyclictest0-21swapper/212:01:172
28471995728,10cyclictest8279-21telnet09:26:172
28469995739,13cyclictest0-21swapper/108:41:421
28469995739,13cyclictest0-21swapper/108:41:421
248599570,6rtkit-daemon2484-21rtkit-daemon11:41:153
2847299565,34cyclictest0-21swapper/306:55:263
2847299565,31cyclictest0-21swapper/308:41:383
2847299565,31cyclictest0-21swapper/308:41:383
2847299565,29cyclictest0-21swapper/311:31:343
2847299564,32cyclictest0-21swapper/309:21:223
2847299564,32cyclictest0-21swapper/309:21:223
28472995620,15cyclictest0-21swapper/309:56:363
28472995613,23cyclictest26264-21head07:46:353
28471995640,9cyclictest28295-21grep07:51:312
28471995616,12cyclictest0-21swapper/210:41:042
2846999565,44cyclictest0-21swapper/110:11:191
2846999564,44cyclictest0-21swapper/107:21:121
2846999564,44cyclictest0-21swapper/107:21:121
2846999564,30cyclictest0-21swapper/111:26:191
2846999564,30cyclictest0-21swapper/111:26:191
28469995624,14cyclictest0-21swapper/111:46:011
248599560,5rtkit-daemon2484-21rtkit-daemon10:26:473
44672553,7sleep24471-21idleruntime-cro08:11:092
2847299554,30cyclictest0-21swapper/308:36:273
28472995522,13cyclictest0-21swapper/308:01:453
28472995517,22cyclictest1419-21runrttasks10:11:173
2847199553,46cyclictest31995-21munin-run08:01:092
2847199553,46cyclictest31995-21munin-run08:01:092
28469995520,12cyclictest0-21swapper/111:16:271
28469995517,15cyclictest0-21swapper/108:56:191
2847299546,28cyclictest0-21swapper/308:26:193
2847299545,28cyclictest0-21swapper/310:31:173
2847299545,28cyclictest0-21swapper/309:51:243
2847299544,30cyclictest0-21swapper/311:11:123
2847299544,28cyclictest0-21swapper/311:56:243
2847299544,27cyclictest0-21swapper/307:26:123
28472995435,10cyclictest21974-21unixbench_multi07:36:443
28472995423,13cyclictest0-21swapper/307:31:323
28472995422,12cyclictest0-21swapper/306:46:273
28472995420,14cyclictest0-21swapper/311:51:003
28472995420,14cyclictest0-21swapper/311:01:223
2847199543,45cyclictest0-21swapper/207:21:272
28469995424,12cyclictest0-21swapper/111:06:201
28469995424,10cyclictest2025-21cat08:06:101
28469995421,13cyclictest0-21swapper/111:56:291
248599540,5rtkit-daemon2484-21rtkit-daemon10:01:183
248599540,5rtkit-daemon2484-21rtkit-daemon10:01:183
2847299536,27cyclictest0-21swapper/307:11:233
2847299536,27cyclictest0-21swapper/307:11:233
2847299535,28cyclictest0-21swapper/310:21:313
2847299535,28cyclictest0-21swapper/309:04:123
2847299535,28cyclictest0-21swapper/308:31:363
2847299535,27cyclictest0-21swapper/310:41:093
2847299535,27cyclictest0-21swapper/310:41:093
2847299535,27cyclictest0-21swapper/308:11:383
2847299535,26cyclictest0-21swapper/311:26:113
2847299535,26cyclictest0-21swapper/311:26:113
2847299534,29cyclictest0-21swapper/310:56:163
2847299534,28cyclictest0-21swapper/311:36:173
28472995320,13cyclictest0-21swapper/308:56:333
28472995320,13cyclictest0-21swapper/307:56:393
28472995320,13cyclictest0-21swapper/307:56:393
28471995319,13cyclictest0-21swapper/208:16:442
28469995327,8cyclictest6731-21head09:21:241
28469995327,8cyclictest6731-21head09:21:241
28469995323,13cyclictest0-21swapper/109:40:531
28469995321,11cyclictest24977-21munin-node10:01:191
28469995321,11cyclictest24977-21munin-node10:01:191
248599530,5rtkit-daemon2484-21rtkit-daemon07:41:312
220142532,9sleep20-21swapper/209:51:452
307902522,9sleep20-21swapper/206:50:402
2847299525,28cyclictest0-21swapper/307:01:383
2847299525,27cyclictest0-21swapper/309:11:333
2847299525,27cyclictest0-21swapper/308:46:443
2847299525,27cyclictest0-21swapper/307:41:293
2847299525,27cyclictest0-21swapper/307:16:233
2847299525,27cyclictest0-21swapper/307:16:233
2847299525,26cyclictest0-21swapper/312:06:103
2847299525,26cyclictest0-21swapper/312:06:103
2847299524,28cyclictest0-21swapper/311:16:203
2847299524,27cyclictest0-21swapper/312:01:313
2847299524,26cyclictest0-21swapper/308:56:093
28472995221,13cyclictest0-21swapper/309:41:253
28472995220,14cyclictest0-21swapper/307:51:413
28472995219,14cyclictest0-21swapper/307:26:373
28471995221,14cyclictest0-21swapper/208:06:112
28471995219,13cyclictest0-21swapper/208:21:282
28471995219,13cyclictest0-21swapper/208:16:102
2846999525,26cyclictest0-21swapper/107:11:121
2846999523,25cyclictest0-21swapper/108:16:221
28469995224,10cyclictest23425-21gltestperf09:56:251
28469995220,14cyclictest0-21swapper/107:36:401
28466995236,10cyclictest12439-21grep07:16:450
28466995236,10cyclictest12439-21grep07:16:450
28466995232,8cyclictest1287-21snmpd09:10:480
28272524,41sleep20-21swapper/211:26:452
28272524,41sleep20-21swapper/211:26:452
262302523,12sleep20-21swapper/210:01:332
262302523,12sleep20-21swapper/210:01:332
248599520,5rtkit-daemon2484-21rtkit-daemon09:26:353
248599520,5rtkit-daemon2484-21rtkit-daemon07:46:392
248599520,5rtkit-daemon2484-21rtkit-daemon07:20:022
248599520,5rtkit-daemon2484-21rtkit-daemon07:20:022
248599520,5rtkit-daemon2484-21rtkit-daemon07:15:022
248599520,5rtkit-daemon2484-21rtkit-daemon07:15:022
176132522,9sleep20-21swapper/207:30:512
2847299515,27cyclictest0-21swapper/310:06:213
2847299515,27cyclictest0-21swapper/309:31:183
2847299515,26cyclictest0-21swapper/309:36:113
2847299514,28cyclictest0-21swapper/309:16:233
2847299514,28cyclictest0-21swapper/308:06:403
2847299514,28cyclictest0-21swapper/307:06:263
2847299514,27cyclictest0-21swapper/310:36:233
2847299514,27cyclictest0-21swapper/309:46:253
28472995120,14cyclictest0-21swapper/311:24:213
28472995118,14cyclictest0-21swapper/310:51:193
2847199514,27cyclictest0-21swapper/206:51:432
2847199513,42cyclictest30766-21munin-run09:06:062
2847199513,42cyclictest0-21swapper/206:56:312
28471995119,12cyclictest0-21swapper/209:26:062
28471995119,12cyclictest0-21swapper/209:26:062
2846999515,27cyclictest0-21swapper/107:26:121
2846999513,27cyclictest0-21swapper/107:36:111
28469995122,13cyclictest0-21swapper/110:26:271
28469995121,13cyclictest0-21swapper/110:26:001
28469995121,13cyclictest0-21swapper/109:20:501
28469995119,14cyclictest0-21swapper/107:26:291
28469995111,23cyclictest0-21swapper/108:30:411
28466995130,9cyclictest1287-21snmpd08:35:420
28466995127,9cyclictest5872-21aten_r1power_fr11:36:130
28466995125,12cyclictest0-21swapper/011:21:330
248599510,4rtkit-daemon2484-21rtkit-daemon07:36:472
219952510,4sleep2281ktimersoftd/211:01:212
199062512,10sleep20-21swapper/209:50:202
131582512,41sleep013231-21basename07:21:210
317182504,39sleep00-21swapper/010:13:440
2847299504,27cyclictest0-21swapper/309:09:183
28472995017,13cyclictest0-21swapper/308:21:353
28471995035,9cyclictest23218-21grep12:11:182
2847199503,39cyclictest0-21swapper/210:11:212
2847199503,26cyclictest0-21swapper/210:26:222
28471995023,9cyclictest22593-21munin-node09:56:232
28471995017,13cyclictest0-21swapper/208:36:092
28471995010,12cyclictest0-21swapper/211:16:132
2846999507,26cyclictest0-21swapper/108:00:361
2846999507,26cyclictest0-21swapper/108:00:361
2846999506,26cyclictest0-21swapper/108:36:291
2846999505,26cyclictest0-21swapper/111:21:201
2846999504,28cyclictest0-21swapper/112:06:161
2846999504,28cyclictest0-21swapper/112:06:161
2846999504,27cyclictest0-21swapper/107:00:271
28469995020,13cyclictest0-21swapper/107:50:341
28469995016,12cyclictest0-21swapper/110:56:371
28469995015,13cyclictest0-21swapper/109:26:391
28466995021,12cyclictest0-21swapper/010:56:030
280552502,10sleep20-21swapper/208:57:082
233932505,38sleep00-21swapper/011:04:420
134502503,8sleep213581-21unixbench_multi08:26:412
113872503,41sleep10-21swapper/108:23:091
30022494,39sleep00-21swapper/006:57:070
2847299494,27cyclictest0-21swapper/308:16:273
2847299494,26cyclictest0-21swapper/310:46:403
2847299494,26cyclictest0-21swapper/310:46:403
2847299494,26cyclictest0-21swapper/307:00:273
2847199493,41cyclictest0-21swapper/210:56:392
2847199493,27cyclictest0-21swapper/209:36:282
2847199493,26cyclictest0-21swapper/211:16:022
28471994924,9cyclictest1287-21snmpd12:06:182
28471994924,9cyclictest1287-21snmpd12:06:182
28471994923,8cyclictest14192-21munin-node10:46:322
28471994923,8cyclictest14192-21munin-node10:46:322
28471994922,12cyclictest0-21swapper/211:41:222
28471994918,12cyclictest0-21swapper/210:53:212
2846999495,26cyclictest0-21swapper/111:51:311
2846999495,26cyclictest0-21swapper/108:10:381
2846999494,38cyclictest0-21swapper/106:46:251
2846999494,28cyclictest0-21swapper/110:06:281
2846999494,26cyclictest0-21swapper/111:11:081
2846999494,26cyclictest0-21swapper/110:16:151
2846999494,11cyclictest0-21swapper/110:41:291
2846999494,11cyclictest0-21swapper/110:41:291
28469994933,11cyclictest0-21swapper/110:34:091
28469994930,10cyclictest12029-21processes09:31:351
2846999493,40cyclictest4055-21grep11:31:191
28469994921,12cyclictest0-21swapper/110:56:041
28469994917,13cyclictest0-21swapper/111:01:061
28469994916,12cyclictest0-21swapper/106:51:241
28466994923,12cyclictest0-21swapper/008:36:370
28466994921,8cyclictest8355-21ntpdc08:16:370
175072493,39sleep00-21swapper/007:29:270
161462492,41sleep00-21swapper/010:48:300
161462492,41sleep00-21swapper/010:48:300
102372496,38sleep00-21swapper/009:29:020
53982485,38sleep00-21swapper/011:34:120
293032482,9sleep20-21swapper/210:08:182
2847199484,26cyclictest0-21swapper/210:21:372
2847199483,39cyclictest0-21swapper/208:41:252
2847199483,39cyclictest0-21swapper/208:41:252
2847199483,38cyclictest0-21swapper/210:31:192
28471994819,13cyclictest0-21swapper/210:16:212
28471994817,13cyclictest0-21swapper/208:36:272
2846999486,25cyclictest0-21swapper/110:46:321
2846999486,25cyclictest0-21swapper/110:46:321
2846999485,25cyclictest0-21swapper/107:05:271
2846999485,12cyclictest6532sleep109:10:491
2846999484,24cyclictest10566-21munin-node11:46:311
2846999484,13cyclictest0-21swapper/108:56:071
2846999483,25cyclictest17820-21munin-node09:46:331
2846699488,33cyclictest0-21swapper/008:21:200
282582484,39sleep00-21swapper/006:43:570
247852483,39sleep10-21swapper/107:45:491
223242484,10sleep10-21swapper/109:55:471
208552482,41sleep00-21swapper/010:57:410
18052482,40sleep00-21swapper/010:20:090
28471994732,9cyclictest12329-21grep11:46:332
28471994718,12cyclictest0-21swapper/210:41:152
28471994718,12cyclictest0-21swapper/210:41:152
2846999474,26cyclictest0-21swapper/111:36:071
2846999473,27cyclictest0-21swapper/108:31:211
28469994719,12cyclictest0-21swapper/109:16:011
28469994717,11cyclictest4707-21munin-node08:11:291
28469994712,12cyclictest0-21swapper/109:01:241
28469994711,10cyclictest0-21swapper/110:36:201
2846699473,12cyclictest0-21swapper/007:01:250
28466994722,11cyclictest0-21swapper/007:56:330
28466994722,11cyclictest0-21swapper/007:56:330
28466994720,12cyclictest0-21swapper/009:51:350
4012462,37sleep20-21swapper/209:07:362
2847199463,25cyclictest5943-21munin-node07:06:472
28471994614,13cyclictest0-21swapper/209:46:052
2846999466,22cyclictest1419-21runrttasks08:46:211
2846999465,36cyclictest0-21swapper/107:56:101
2846999465,14cyclictest0-21swapper/107:16:111
2846999465,14cyclictest0-21swapper/107:16:111
2846699464,35cyclictest0-21swapper/009:41:210
2846699464,35cyclictest0-21swapper/008:51:210
2846699463,37cyclictest0-21swapper/008:46:290
2846699463,37cyclictest0-21swapper/007:46:220
2846699463,36cyclictest575-21grep08:01:290
28466994624,8cyclictest4630-21munin-node10:26:300
28466994621,11cyclictest0-21swapper/009:01:270
28466994620,11cyclictest0-21swapper/011:41:150
79072452,9sleep20-21swapper/211:40:352
28471994529,9cyclictest15469-21head11:56:132
28471994522,8cyclictest924-21munin-node09:11:282
28471994521,9cyclictest1287-21snmpd09:21:062
28469994513,9cyclictest16764-21proc_pri09:41:361
2846699455,33cyclictest0-21swapper/007:46:110
2846699454,35cyclictest0-21swapper/012:11:120
2846699454,35cyclictest0-21swapper/009:56:360
2846699454,35cyclictest0-21swapper/009:11:360
2846699454,25cyclictest0-21swapper/009:46:260
2846699453,34cyclictest29542-21grep06:46:330
2846699453,34cyclictest0-21swapper/007:11:240
2846699453,34cyclictest0-21swapper/007:11:240
2846699453,10cyclictest13022-21aten_r1power_fr11:51:120
28466994526,14cyclictest0-21swapper/007:51:280
28466994525,9cyclictest0-21swapper/008:56:360
28466994520,8cyclictest4472-21latency_hist08:11:100
28466994519,8cyclictest6855-21latency_hist08:16:100
28466994518,12cyclictest0-21swapper/011:16:110
28471994415,8cyclictest16395-21kworker/2:109:31:192
2846699444,33cyclictest0-21swapper/009:36:230
2846699444,13cyclictest0-21swapper/011:11:270
2846699443,37cyclictest0-21swapper/006:51:410
2846699443,35cyclictest0-21swapper/007:31:460
28466994421,18cyclictest1419-21runrttasks07:09:580
243922443,34sleep10-21swapper/112:12:421
20652442,35sleep00-21swapper/010:21:050
28471994329,8cyclictest22304-21cut08:46:282
2846999434,32cyclictest0-21swapper/106:46:131
2846699434,33cyclictest0-21swapper/012:06:220
2846699434,33cyclictest0-21swapper/012:06:220
2846699434,33cyclictest0-21swapper/010:41:030
2846699433,34cyclictest0-21swapper/010:31:230
2846699433,32cyclictest0-21swapper/011:26:140
2846699433,32cyclictest0-21swapper/011:26:140
2846699433,13cyclictest0-21swapper/009:16:410
28466994325,12cyclictest0-21swapper/010:06:170
2846699423,34cyclictest0-21swapper/008:45:130
2846699423,34cyclictest0-21swapper/008:45:130
28466994224,12cyclictest0-21swapper/009:21:170
28466994224,12cyclictest0-21swapper/009:21:170
28466994221,11cyclictest0-21swapper/011:06:200
195752422,35sleep00-21swapper/012:02:050
2847299412,23cyclictest0-21swapper/306:46:133
28466994110,18cyclictest0-21swapper/010:41:200
28466994110,18cyclictest0-21swapper/010:41:200
173032412,34sleep00-21swapper/011:58:350
2847199403,23cyclictest0-21swapper/208:55:132
28471993517,12cyclictest0-21swapper/206:46:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional